Skip to content

Change default segment size#7449

Draft
mprammer wants to merge 1 commit intodevelopfrom
mp/resize-segment
Draft

Change default segment size#7449
mprammer wants to merge 1 commit intodevelopfrom
mp/resize-segment

Conversation

@mprammer
Copy link
Copy Markdown

@mprammer mprammer commented Apr 15, 2026

Summary

Changes the default segment size. PR for testing.

Testing

N/A

@mprammer
benchmark resizing segments
39d4ffa 
Signed-off-by: Martin Prammer <martin@spiraldb.com>
@mprammer mprammer requested a review from gatesn April 15, 2026 17:52
@mprammer mprammer added the action/benchmark Trigger full benchmarks to run on this PR label Apr 15, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 15, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 15, 2026 •
edited
Loading

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 39d4ffa 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 15, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.188x ❌

datafusion / vortex-file-compressed (1.188x ❌, 0↑ 8↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 132921175 123463961 1.08
polarsignals_q01/datafusion:vortex-file-compressed 🚨 443200924 371445022 1.19
polarsignals_q02/datafusion:vortex-file-compressed 🚨 28293486 23012351 1.23
polarsignals_q03/datafusion:vortex-file-compressed 🚨 448605652 370061737 1.21
polarsignals_q04/datafusion:vortex-file-compressed 🚨 14985222 12282654 1.22
polarsignals_q05/datafusion:vortex-file-compressed 🚨 21661127 16159665 1.34
polarsignals_q06/datafusion:vortex-file-compressed 🚨 22904820 19731894 1.16
polarsignals_q07/datafusion:vortex-file-compressed 🚨 19307166 13988443 1.38
polarsignals_q08/datafusion:vortex-file-compressed 461214786 454293051 1.02
polarsignals_q09/datafusion:vortex-file-compressed 🚨 12405832 11257771 1.10

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 15, 2026

File Sizes: PolarSignals Profiling

File Size Changes (1 files changed, +0.1% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 689.06 MB 689.53 MB +479.23 KB +0.1%

Totals:

  • vortex-file-compressed: 689.06 MB → 689.53 MB (+0.1%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 15, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.4%
Vortex (geomean): 0.955x ➖
Parquet (geomean): 0.969x ➖
Shifts: Parquet (control) -3.1% · Median polish -3.1%

datafusion / vortex-file-compressed (0.972x ➖, 1↑ 1↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 6159777 5192115 1.19
fineweb_q01/datafusion:vortex-file-compressed 30254055 28695748 1.05
fineweb_q02/datafusion:vortex-file-compressed 29495788 31357337 0.94
fineweb_q03/datafusion:vortex-file-compressed 🚀 85694649 99634280 0.86
fineweb_q04/datafusion:vortex-file-compressed 250287523 263174176 0.95
fineweb_q05/datafusion:vortex-file-compressed 235036553 237039565 0.99
fineweb_q06/datafusion:vortex-file-compressed 67153296 70705459 0.95
fineweb_q07/datafusion:vortex-file-compressed 72320473 77942068 0.93
fineweb_q08/datafusion:vortex-file-compressed 27191977 29485831 0.92
datafusion / vortex-compact (0.930x ➖, 4↑ 1↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 4899299 5169722 0.95
fineweb_q01/datafusion:vortex-compact 159185021 170433630 0.93
fineweb_q02/datafusion:vortex-compact 160986648 169028917 0.95
fineweb_q03/datafusion:vortex-compact 🚀 1306647494 1467755369 0.89
fineweb_q04/datafusion:vortex-compact 🚀 1418408213 1601381083 0.89
fineweb_q05/datafusion:vortex-compact 🚀 1155481401 1291456111 0.89
fineweb_q06/datafusion:vortex-compact 🚀 637079217 739484024 0.86
fineweb_q07/datafusion:vortex-compact 672098199 746303309 0.90
fineweb_q08/datafusion:vortex-compact 🚨 26503337 23458618 1.13
datafusion / parquet (0.983x ➖, 0↑ 0↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6844378 7035780 0.97
fineweb_q01/datafusion:parquet 282952669 289058879 0.98
fineweb_q02/datafusion:parquet 282772717 295519108 0.96
fineweb_q03/datafusion:parquet 289548932 290073113 1.00
fineweb_q04/datafusion:parquet 297887850 302230450 0.99
fineweb_q05/datafusion:parquet 294995255 299025647 0.99
fineweb_q06/datafusion:parquet 284994288 290999234 0.98
fineweb_q07/datafusion:parquet 281147210 283864851 0.99
fineweb_q08/datafusion:parquet 279324943 279857054 1.00
duckdb / vortex-file-compressed (0.966x ➖, 1↑ 2↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀 2284696 3888743 0.59
fineweb_q01/duckdb:vortex-file-compressed 26974937 29455668 0.92
fineweb_q02/duckdb:vortex-file-compressed 🚨 32022315 26324261 1.22
fineweb_q03/duckdb:vortex-file-compressed 🚨 174882041 142561994 1.23
fineweb_q04/duckdb:vortex-file-compressed 232714168 235951438 0.99
fineweb_q05/duckdb:vortex-file-compressed 223698752 228161380 0.98
fineweb_q06/duckdb:vortex-file-compressed 66349449 67836990 0.98
fineweb_q07/duckdb:vortex-file-compressed 64041714 67830438 0.94
fineweb_q08/duckdb:vortex-file-compressed 25801405 25342819 1.02
duckdb / vortex-compact (0.952x ➖, 1↑ 1↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚀 2683430 4199981 0.64
fineweb_q01/duckdb:vortex-compact 111141809 111590912 1.00
fineweb_q02/duckdb:vortex-compact 112818620 115641744 0.98
fineweb_q03/duckdb:vortex-compact 859027303 872742924 0.98
fineweb_q04/duckdb:vortex-compact 904778926 917303806 0.99
fineweb_q05/duckdb:vortex-compact 818211491 827451545 0.99
fineweb_q06/duckdb:vortex-compact 461929383 475006711 0.97
fineweb_q07/duckdb:vortex-compact 477911837 474091778 1.01
fineweb_q08/duckdb:vortex-compact 🚨 23987757 21779314 1.10
duckdb / parquet (0.955x ➖, 0↑ 0↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 35923270 38293315 0.94
fineweb_q01/duckdb:parquet 91390864 97420308 0.94
fineweb_q02/duckdb:parquet 94675746 101178474 0.94
fineweb_q03/duckdb:parquet 305778889 321404460 0.95
fineweb_q04/duckdb:parquet 436498452 446781072 0.98
fineweb_q05/duckdb:parquet 408447914 418248305 0.98
fineweb_q06/duckdb:parquet 198130790 204586914 0.97
fineweb_q07/duckdb:parquet 207807253 213155707 0.97
fineweb_q08/duckdb:parquet 56431613 60451393 0.93
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -5.2% -4.5% -0.8% +31.2% ➖ noise
0 datafusion:vortex-file-compressed +18.6% -4.5% +24.2% +64.8% ➖ noise
0 duckdb:vortex-compact -36.1% -4.5% -33.1% +35.1% ✅ faster
0 duckdb:vortex-file-compressed -41.2% -4.5% -38.5% +52.5% ✅ faster
1 datafusion:vortex-compact -6.6% -4.2% -2.5% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +5.4% -4.2% +10.0% +17.4% ➖ noise
1 duckdb:vortex-compact -0.4% -4.2% +3.9% +16.5% ➖ noise
1 duckdb:vortex-file-compressed -8.4% -4.2% -4.4% +39.6% ➖ noise
2 datafusion:vortex-compact -4.8% -5.4% +0.7% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -5.9% -5.4% -0.6% +10.0% ➖ noise
2 duckdb:vortex-compact -2.4% -5.4% +3.1% +13.6% ➖ noise
2 duckdb:vortex-file-compressed +21.6% -5.4% +28.6% +10.4% 🚨 regression
3 datafusion:vortex-compact -11.0% -2.5% -8.6% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -14.0% -2.5% -11.7% +43.5% ➖ noise
3 duckdb:vortex-compact -1.6% -2.5% +1.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +22.7% -2.5% +25.9% +24.7% 🚨 regression
4 datafusion:vortex-compact -11.4% -1.9% -9.7% +10.0% ✅ faster
4 datafusion:vortex-file-compressed -4.9% -1.9% -3.1% +10.0% ➖ noise
4 duckdb:vortex-compact -1.4% -1.9% +0.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.4% -1.9% +0.5% +10.0% ➖ noise
5 datafusion:vortex-compact -10.5% -1.8% -8.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -0.8% -1.8% +1.0% +10.0% ➖ noise
5 duckdb:vortex-compact -1.1% -1.8% +0.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -2.0% -1.8% -0.1% +10.0% ➖ noise
6 datafusion:vortex-compact -13.8% -2.6% -11.5% +10.0% ✅ faster
6 datafusion:vortex-file-compressed -5.0% -2.6% -2.5% +12.8% ➖ noise
6 duckdb:vortex-compact -2.8% -2.6% -0.1% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -2.2% -2.6% +0.4% +10.0% ➖ noise
7 datafusion:vortex-compact -9.9% -1.7% -8.4% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -7.2% -1.7% -5.6% +10.0% ➖ noise
7 duckdb:vortex-compact +0.8% -1.7% +2.6% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -5.6% -1.7% -3.9% +13.2% ➖ noise
8 datafusion:vortex-compact +13.0% -3.5% +17.0% +24.3% ➖ noise
8 datafusion:vortex-file-compressed -7.8% -3.5% -4.5% +41.4% ➖ noise
8 duckdb:vortex-compact +10.1% -3.5% +14.1% +12.8% 🚨 regression
8 duckdb:vortex-file-compressed +1.8% -3.5% +5.5% +20.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 15, 2026

File Sizes: FineWeb NVMe

File Size Changes (2 files changed, +0.0% overall, 2↑ 0↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.79 GB 1.79 GB +272.64 KB +0.0%
sample.vortex 1.0 vortex-compact 1.23 GB 1.23 GB +120.09 KB +0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (+0.0%)
  • vortex-file-compressed: 1.79 GB → 1.79 GB (+0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 15, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +15.0%
Vortex (geomean): 1.238x ❌
Parquet (geomean): 0.987x ➖
Shifts: Parquet (control) -1.3% · Median polish +8.9%

datafusion / vortex-file-compressed (1.350x ❌, 0↑ 16↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 57507061 49791160 1.15
tpch_q02/datafusion:vortex-file-compressed 36259258 33328093 1.09
tpch_q03/datafusion:vortex-file-compressed 🚨 38211715 28052853 1.36
tpch_q04/datafusion:vortex-file-compressed 🚨 31857546 19391624 1.64
tpch_q05/datafusion:vortex-file-compressed 🚨 62692126 54153688 1.16
tpch_q06/datafusion:vortex-file-compressed 🚨 30751169 10939995 2.81
tpch_q07/datafusion:vortex-file-compressed 🚨 79457340 64943858 1.22
tpch_q08/datafusion:vortex-file-compressed 🚨 56418479 44703597 1.26
tpch_q09/datafusion:vortex-file-compressed 🚨 65034555 56024572 1.16
tpch_q10/datafusion:vortex-file-compressed 🚨 58649207 45409224 1.29
tpch_q11/datafusion:vortex-file-compressed 🚨 21316983 18263427 1.17
tpch_q12/datafusion:vortex-file-compressed 🚨 52264277 24253006 2.15
tpch_q13/datafusion:vortex-file-compressed 28828898 28456758 1.01
tpch_q14/datafusion:vortex-file-compressed 🚨 29681870 17155552 1.73
tpch_q15/datafusion:vortex-file-compressed 🚨 49502436 25511831 1.94
tpch_q16/datafusion:vortex-file-compressed 26884867 25945260 1.04
tpch_q17/datafusion:vortex-file-compressed 70559985 66744760 1.06
tpch_q18/datafusion:vortex-file-compressed 88857075 81877903 1.09
tpch_q19/datafusion:vortex-file-compressed 🚨 46032648 24592898 1.87
tpch_q20/datafusion:vortex-file-compressed 🚨 45043005 33398946 1.35
tpch_q21/datafusion:vortex-file-compressed 🚨 93656792 76269628 1.23
tpch_q22/datafusion:vortex-file-compressed 17610721 16091709 1.09
datafusion / vortex-compact (1.248x ❌, 0↑ 15↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 78732323 59364199 1.33
tpch_q02/datafusion:vortex-compact 37686321 37195615 1.01
tpch_q03/datafusion:vortex-compact 🚨 39997699 31325941 1.28
tpch_q04/datafusion:vortex-compact 🚨 35883695 24816519 1.45
tpch_q05/datafusion:vortex-compact 🚨 65654392 57813726 1.14
tpch_q06/datafusion:vortex-compact 🚨 32546158 13538820 2.40
tpch_q07/datafusion:vortex-compact 🚨 83154192 70452871 1.18
tpch_q08/datafusion:vortex-compact 🚨 56700281 51081649 1.11
tpch_q09/datafusion:vortex-compact 🚨 69482586 61224114 1.13
tpch_q10/datafusion:vortex-compact 🚨 66754156 53268719 1.25
tpch_q11/datafusion:vortex-compact 21380683 20297706 1.05
tpch_q12/datafusion:vortex-compact 🚨 61161942 34111462 1.79
tpch_q13/datafusion:vortex-compact 36600865 36634276 1.00
tpch_q14/datafusion:vortex-compact 🚨 33414888 21197066 1.58
tpch_q15/datafusion:vortex-compact 🚨 55906458 35347725 1.58
tpch_q16/datafusion:vortex-compact 28109059 30688752 0.92
tpch_q17/datafusion:vortex-compact 72729356 71793682 1.01
tpch_q18/datafusion:vortex-compact 92452962 86032688 1.07
tpch_q19/datafusion:vortex-compact 🚨 52672409 34702989 1.52
tpch_q20/datafusion:vortex-compact 🚨 47943413 38853992 1.23
tpch_q21/datafusion:vortex-compact 🚨 101602508 88014176 1.15
tpch_q22/datafusion:vortex-compact 18084369 17664786 1.02
datafusion / parquet (0.982x ➖, 1↑ 0↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 106131448 138086353 0.77
tpch_q02/datafusion:parquet 70066636 71826586 0.98
tpch_q03/datafusion:parquet 75312814 82022491 0.92
tpch_q04/datafusion:parquet 48233948 50150744 0.96
tpch_q05/datafusion:parquet 103427182 106006490 0.98
tpch_q06/datafusion:parquet 43916599 40112583 1.09
tpch_q07/datafusion:parquet 114212727 117251832 0.97
tpch_q08/datafusion:parquet 106954034 102032941 1.05
tpch_q09/datafusion:parquet 135216396 134690599 1.00
tpch_q10/datafusion:parquet 120547822 123375057 0.98
tpch_q11/datafusion:parquet 48806892 49121468 0.99
tpch_q12/datafusion:parquet 95281520 88404281 1.08
tpch_q13/datafusion:parquet 206824845 207254554 1.00
tpch_q14/datafusion:parquet 44681811 45060787 0.99
tpch_q15/datafusion:parquet 66883830 67568633 0.99
tpch_q16/datafusion:parquet 50115276 51813797 0.97
tpch_q17/datafusion:parquet 140070019 136730731 1.02
tpch_q18/datafusion:parquet 164707442 174246733 0.95
tpch_q19/datafusion:parquet 86663389 94130993 0.92
tpch_q20/datafusion:parquet 79144367 73496079 1.08
tpch_q21/datafusion:parquet 144914728 153063969 0.95
tpch_q22/datafusion:parquet 34747889 34079324 1.02
datafusion / arrow (0.955x ➖, 2↑ 0↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 52530136 57149200 0.92
tpch_q02/datafusion:arrow 21525725 22029795 0.98
tpch_q03/datafusion:arrow 32270888 34937643 0.92
tpch_q04/datafusion:arrow 26324701 29192207 0.90
tpch_q05/datafusion:arrow 🚀 75056763 83707315 0.90
tpch_q06/datafusion:arrow 20310333 21786144 0.93
tpch_q07/datafusion:arrow 117003835 113141264 1.03
tpch_q08/datafusion:arrow 43778015 44259361 0.99
tpch_q09/datafusion:arrow 68917276 72002657 0.96
tpch_q10/datafusion:arrow 50470025 51987399 0.97
tpch_q11/datafusion:arrow 11402956 11619516 0.98
tpch_q12/datafusion:arrow 53791950 53854055 1.00
tpch_q13/datafusion:arrow 48427093 49433872 0.98
tpch_q14/datafusion:arrow 22142949 22960111 0.96
tpch_q15/datafusion:arrow 44047746 44539853 0.99
tpch_q16/datafusion:arrow 20646577 21170341 0.98
tpch_q17/datafusion:arrow 70770417 71214066 0.99
tpch_q18/datafusion:arrow 142053524 146991124 0.97
tpch_q19/datafusion:arrow 🚀 37928293 45535999 0.83
tpch_q20/datafusion:arrow 37786935 41650592 0.91
tpch_q21/datafusion:arrow 149655764 155418837 0.96
tpch_q22/datafusion:arrow 19521296 20042841 0.97
duckdb / vortex-file-compressed (1.219x ❌, 0↑ 14↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 37599798 33594563 1.12
tpch_q02/duckdb:vortex-file-compressed 29751110 28146866 1.06
tpch_q03/duckdb:vortex-file-compressed 🚨 38194448 29102637 1.31
tpch_q04/duckdb:vortex-file-compressed 🚨 35528046 31264192 1.14
tpch_q05/duckdb:vortex-file-compressed 🚨 42524469 35933688 1.18
tpch_q06/duckdb:vortex-file-compressed 🚨 28674618 11698146 2.45
tpch_q07/duckdb:vortex-file-compressed 🚨 50701145 38777032 1.31
tpch_q08/duckdb:vortex-file-compressed 🚨 49885184 42449038 1.18
tpch_q09/duckdb:vortex-file-compressed 86264031 83609850 1.03
tpch_q10/duckdb:vortex-file-compressed 🚨 49790411 38255976 1.30
tpch_q11/duckdb:vortex-file-compressed 16526705 17106084 0.97
tpch_q12/duckdb:vortex-file-compressed 🚨 43280277 24974138 1.73
tpch_q13/duckdb:vortex-file-compressed 39097679 38506869 1.02
tpch_q14/duckdb:vortex-file-compressed 🚨 34002471 21640216 1.57
tpch_q15/duckdb:vortex-file-compressed 🚨 22725735 16930726 1.34
tpch_q16/duckdb:vortex-file-compressed 30534191 31459194 0.97
tpch_q17/duckdb:vortex-file-compressed 🚨 37341687 26551838 1.41
tpch_q18/duckdb:vortex-file-compressed 🚨 58448064 51678323 1.13
tpch_q19/duckdb:vortex-file-compressed 33183716 31901338 1.04
tpch_q20/duckdb:vortex-file-compressed 🚨 44401928 36306453 1.22
tpch_q21/duckdb:vortex-file-compressed 123328400 112729784 1.09
tpch_q22/duckdb:vortex-file-compressed 19083118 19748497 0.97
duckdb / vortex-compact (1.143x ❌, 3↑ 14↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚨 58616756 39499273 1.48
tpch_q02/duckdb:vortex-compact 🚀 33114666 39049960 0.85
tpch_q03/duckdb:vortex-compact 🚨 40301381 32256614 1.25
tpch_q04/duckdb:vortex-compact 🚨 39358246 34285344 1.15
tpch_q05/duckdb:vortex-compact 🚨 44965464 38366013 1.17
tpch_q06/duckdb:vortex-compact 🚨 32786563 14993934 2.19
tpch_q07/duckdb:vortex-compact 🚨 56133587 44602764 1.26
tpch_q08/duckdb:vortex-compact 🚨 53204170 46172221 1.15
tpch_q09/duckdb:vortex-compact 92506596 96245038 0.96
tpch_q10/duckdb:vortex-compact 🚨 52015129 42642336 1.22
tpch_q11/duckdb:vortex-compact 🚀 16830971 20554603 0.82
tpch_q12/duckdb:vortex-compact 🚨 54671398 36190759 1.51
tpch_q13/duckdb:vortex-compact 42985232 46909483 0.92
tpch_q14/duckdb:vortex-compact 🚨 38173209 31836048 1.20
tpch_q15/duckdb:vortex-compact 🚨 25390286 20122221 1.26
tpch_q16/duckdb:vortex-compact 🚀 30280486 36318593 0.83
tpch_q17/duckdb:vortex-compact 🚨 42591946 31224241 1.36
tpch_q18/duckdb:vortex-compact 55033931 53381630 1.03
tpch_q19/duckdb:vortex-compact 35776576 35779154 1.00
tpch_q20/duckdb:vortex-compact 🚨 51128593 45368831 1.13
tpch_q21/duckdb:vortex-compact 🚨 133479284 117209121 1.14
tpch_q22/duckdb:vortex-compact 20129613 21677111 0.93
duckdb / parquet (0.992x ➖, 2↑ 2↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 83244047 80488736 1.03
tpch_q02/duckdb:parquet 39091471 40037431 0.98
tpch_q03/duckdb:parquet 69360975 69770788 0.99
tpch_q04/duckdb:parquet 50856236 47634263 1.07
tpch_q05/duckdb:parquet 70848998 68298493 1.04
tpch_q06/duckdb:parquet 🚀 20234104 29503600 0.69
tpch_q07/duckdb:parquet 73719325 70839259 1.04
tpch_q08/duckdb:parquet 🚨 90339010 80828391 1.12
tpch_q09/duckdb:parquet 155410095 157983703 0.98
tpch_q10/duckdb:parquet 126845632 125600305 1.01
tpch_q11/duckdb:parquet 22317138 22207267 1.00
tpch_q12/duckdb:parquet 45915850 45569201 1.01
tpch_q13/duckdb:parquet 264246816 263651529 1.00
tpch_q14/duckdb:parquet 48509936 48771311 0.99
tpch_q15/duckdb:parquet 24214296 24187230 1.00
tpch_q16/duckdb:parquet 54919744 54850936 1.00
tpch_q17/duckdb:parquet 54488216 53389645 1.02
tpch_q18/duckdb:parquet 120269516 120627077 1.00
tpch_q19/duckdb:parquet 🚀 70929935 83514149 0.85
tpch_q20/duckdb:parquet 🚨 72249800 63845257 1.13
tpch_q21/duckdb:parquet 167469669 173640112 0.96
tpch_q22/duckdb:parquet 51691719 52280429 0.99
duckdb / duckdb (0.950x ➖, 3↑ 0↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 15958788 16277881 0.98
tpch_q02/duckdb:duckdb 11927556 12992013 0.92
tpch_q03/duckdb:duckdb 18641072 20147474 0.93
tpch_q04/duckdb:duckdb 18860179 19853588 0.95
tpch_q05/duckdb:duckdb 20241215 20372578 0.99
tpch_q06/duckdb:duckdb 5280953 5483735 0.96
tpch_q07/duckdb:duckdb 🚀 22136572 25054326 0.88
tpch_q08/duckdb:duckdb 21005614 21658240 0.97
tpch_q09/duckdb:duckdb 52822131 58252348 0.91
tpch_q10/duckdb:duckdb 42531102 46210138 0.92
tpch_q11/duckdb:duckdb 5617977 5963904 0.94
tpch_q12/duckdb:duckdb 13713706 13903470 0.99
tpch_q13/duckdb:duckdb 38490705 38578500 1.00
tpch_q14/duckdb:duckdb 🚀 16338752 18903762 0.86
tpch_q15/duckdb:duckdb 11830398 11841793 1.00
tpch_q16/duckdb:duckdb 23292216 23491233 0.99
tpch_q17/duckdb:duckdb 13778865 14634864 0.94
tpch_q18/duckdb:duckdb 38287016 38472874 1.00
tpch_q19/duckdb:duckdb 🚀 26284852 30201462 0.87
tpch_q20/duckdb:duckdb 22637966 22880946 0.99
tpch_q21/duckdb:duckdb 55886818 57472609 0.97
tpch_q22/duckdb:duckdb 23985236 24763931 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -8.1% -10.8% +3.1% +22.6% ➖ noise
1 datafusion:vortex-compact +32.6% -10.8% +48.8% +19.9% 🚨 regression
1 datafusion:vortex-file-compressed +15.5% -10.8% +29.5% +22.5% 🚨 regression
1 duckdb:duckdb -2.0% -10.8% +10.0% +19.9% ➖ noise
1 duckdb:vortex-compact +48.4% -10.8% +66.4% +19.1% 🚨 regression
1 duckdb:vortex-file-compressed +11.9% -10.8% +25.5% +18.9% 🚨 regression
2 datafusion:arrow -2.3% -2.4% +0.1% +16.0% ➖ noise
2 datafusion:vortex-compact +1.3% -2.4% +3.8% +16.0% ➖ noise
2 datafusion:vortex-file-compressed +8.8% -2.4% +11.5% +16.0% ➖ noise
2 duckdb:duckdb -8.2% -2.4% -5.9% +16.0% ➖ noise
2 duckdb:vortex-compact -15.2% -2.4% -13.1% +16.0% ➖ noise
2 duckdb:vortex-file-compressed +5.7% -2.4% +8.3% +16.0% ➖ noise
3 datafusion:arrow -7.6% -4.5% -3.3% +16.0% ➖ noise
3 datafusion:vortex-compact +27.7% -4.5% +33.6% +16.0% 🚨 regression
3 datafusion:vortex-file-compressed +36.2% -4.5% +42.6% +16.0% 🚨 regression
3 duckdb:duckdb -7.5% -4.5% -3.2% +16.9% ➖ noise
3 duckdb:vortex-compact +24.9% -4.5% +30.8% +16.0% 🚨 regression
3 duckdb:vortex-file-compressed +31.2% -4.5% +37.4% +16.0% 🚨 regression
4 datafusion:arrow -9.8% +1.3% -11.0% +16.0% ➖ noise
4 datafusion:vortex-compact +44.6% +1.3% +42.7% +16.0% 🚨 regression
4 datafusion:vortex-file-compressed +64.3% +1.3% +62.1% +16.0% 🚨 regression
4 duckdb:duckdb -5.0% +1.3% -6.3% +16.0% ➖ noise
4 duckdb:vortex-compact +14.8% +1.3% +13.3% +16.0% ➖ noise
4 duckdb:vortex-file-compressed +13.6% +1.3% +12.1% +16.0% ➖ noise
5 datafusion:arrow -10.3% +0.6% -10.9% +16.0% ➖ noise
5 datafusion:vortex-compact +13.6% +0.6% +12.9% +16.0% ➖ noise
5 datafusion:vortex-file-compressed +15.8% +0.6% +15.1% +16.0% ➖ noise
5 duckdb:duckdb -0.6% +0.6% -1.2% +16.0% ➖ noise
5 duckdb:vortex-compact +17.2% +0.6% +16.5% +16.0% 🚨 regression
5 duckdb:vortex-file-compressed +18.3% +0.6% +17.6% +16.0% 🚨 regression
6 datafusion:arrow -6.8% -13.3% +7.6% +20.8% ➖ noise
6 datafusion:vortex-compact +140.4% -13.3% +177.4% +20.3% 🚨 regression
6 datafusion:vortex-file-compressed +181.1% -13.3% +224.4% +20.7% 🚨 regression
6 duckdb:duckdb -3.7% -13.3% +11.1% +22.5% ➖ noise
6 duckdb:vortex-compact +118.7% -13.3% +152.3% +20.7% 🚨 regression
6 duckdb:vortex-file-compressed +145.1% -13.3% +182.9% +21.9% 🚨 regression
7 datafusion:arrow +3.4% +0.7% +2.7% +16.0% ➖ noise
7 datafusion:vortex-compact +18.0% +0.7% +17.2% +16.0% 🚨 regression
7 datafusion:vortex-file-compressed +22.3% +0.7% +21.5% +16.0% 🚨 regression
7 duckdb:duckdb -11.6% +0.7% -12.2% +16.0% ➖ noise
7 duckdb:vortex-compact +25.9% +0.7% +25.0% +16.0% 🚨 regression
7 duckdb:vortex-file-compressed +30.8% +0.7% +29.9% +16.0% 🚨 regression
8 datafusion:arrow -1.1% +8.2% -8.6% +16.0% ➖ noise
8 datafusion:vortex-compact +11.0% +8.2% +2.6% +16.0% ➖ noise
8 datafusion:vortex-file-compressed +26.2% +8.2% +16.6% +16.0% 🚨 regression
8 duckdb:duckdb -3.0% +8.2% -10.4% +16.0% ➖ noise
8 duckdb:vortex-compact +15.2% +8.2% +6.5% +16.0% ➖ noise
8 duckdb:vortex-file-compressed +17.5% +8.2% +8.6% +16.0% ➖ noise
9 datafusion:arrow -4.3% -0.6% -3.7% +16.0% ➖ noise
9 datafusion:vortex-compact +13.5% -0.6% +14.2% +16.0% ➖ noise
9 datafusion:vortex-file-compressed +16.1% -0.6% +16.8% +16.0% 🚨 regression
9 duckdb:duckdb -9.3% -0.6% -8.8% +16.0% ➖ noise
9 duckdb:vortex-compact -3.9% -0.6% -3.3% +16.0% ➖ noise
9 duckdb:vortex-file-compressed +3.2% -0.6% +3.8% +16.0% ➖ noise
10 datafusion:arrow -2.9% -0.7% -2.3% +16.0% ➖ noise
10 datafusion:vortex-compact +25.3% -0.7% +26.2% +16.0% 🚨 regression
10 datafusion:vortex-file-compressed +29.2% -0.7% +30.0% +16.0% 🚨 regression
10 duckdb:duckdb -8.0% -0.7% -7.3% +16.0% ➖ noise
10 duckdb:vortex-compact +22.0% -0.7% +22.8% +16.0% 🚨 regression
10 duckdb:vortex-file-compressed +30.2% -0.7% +31.0% +16.0% 🚨 regression
11 datafusion:arrow -1.9% -0.1% -1.8% +16.0% ➖ noise
11 datafusion:vortex-compact +5.3% -0.1% +5.4% +16.0% ➖ noise
11 datafusion:vortex-file-compressed +16.7% -0.1% +16.8% +16.0% 🚨 regression
11 duckdb:duckdb -5.8% -0.1% -5.7% +16.0% ➖ noise
11 duckdb:vortex-compact -18.1% -0.1% -18.1% +16.0% ✅ faster
11 duckdb:vortex-file-compressed -3.4% -0.1% -3.3% +16.0% ➖ noise
12 datafusion:arrow -0.1% +4.2% -4.2% +16.0% ➖ noise
12 datafusion:vortex-compact +79.3% +4.2% +72.1% +16.0% 🚨 regression
12 datafusion:vortex-file-compressed +115.5% +4.2% +106.8% +16.0% 🚨 regression
12 duckdb:duckdb -1.4% +4.2% -5.4% +16.0% ➖ noise
12 duckdb:vortex-compact +51.1% +4.2% +45.0% +16.0% 🚨 regression
12 duckdb:vortex-file-compressed +73.3% +4.2% +66.3% +16.0% 🚨 regression
13 datafusion:arrow -2.0% +0.0% -2.0% +16.0% ➖ noise
13 datafusion:vortex-compact -0.1% +0.0% -0.1% +16.0% ➖ noise
13 datafusion:vortex-file-compressed +1.3% +0.0% +1.3% +16.0% ➖ noise
13 duckdb:duckdb -0.2% +0.0% -0.2% +16.0% ➖ noise
13 duckdb:vortex-compact -8.4% +0.0% -8.4% +16.0% ➖ noise
13 duckdb:vortex-file-compressed +1.5% +0.0% +1.5% +16.0% ➖ noise
14 datafusion:arrow -3.6% -0.7% -2.9% +16.0% ➖ noise
14 datafusion:vortex-compact +57.6% -0.7% +58.7% +16.0% 🚨 regression
14 datafusion:vortex-file-compressed +73.0% -0.7% +74.2% +16.0% 🚨 regression
14 duckdb:duckdb -13.6% -0.7% -13.0% +16.0% ➖ noise
14 duckdb:vortex-compact +19.9% -0.7% +20.7% +16.0% 🚨 regression
14 duckdb:vortex-file-compressed +57.1% -0.7% +58.2% +16.0% 🚨 regression
15 datafusion:arrow -1.1% -0.5% -0.7% +16.0% ➖ noise
15 datafusion:vortex-compact +58.2% -0.5% +58.9% +16.5% 🚨 regression
15 datafusion:vortex-file-compressed +94.0% -0.5% +94.9% +16.0% 🚨 regression
15 duckdb:duckdb -0.1% -0.5% +0.4% +19.6% ➖ noise
15 duckdb:vortex-compact +26.2% -0.5% +26.8% +16.0% 🚨 regression
15 duckdb:vortex-file-compressed +34.2% -0.5% +34.8% +16.0% 🚨 regression
16 datafusion:arrow -2.5% -1.6% -0.9% +16.0% ➖ noise
16 datafusion:vortex-compact -8.4% -1.6% -6.9% +16.0% ➖ noise
16 datafusion:vortex-file-compressed +3.6% -1.6% +5.3% +16.0% ➖ noise
16 duckdb:duckdb -0.8% -1.6% +0.8% +17.3% ➖ noise
16 duckdb:vortex-compact -16.6% -1.6% -15.3% +16.0% ✅ faster
16 duckdb:vortex-file-compressed -2.9% -1.6% -1.4% +16.0% ➖ noise
17 datafusion:arrow -0.6% +2.2% -2.8% +16.0% ➖ noise
17 datafusion:vortex-compact +1.3% +2.2% -0.9% +16.0% ➖ noise
17 datafusion:vortex-file-compressed +5.7% +2.2% +3.4% +16.0% ➖ noise
17 duckdb:duckdb -5.8% +2.2% -7.9% +16.0% ➖ noise
17 duckdb:vortex-compact +36.4% +2.2% +33.4% +16.0% 🚨 regression
17 duckdb:vortex-file-compressed +40.6% +2.2% +37.5% +16.3% 🚨 regression
18 datafusion:arrow -3.4% -2.9% -0.5% +16.0% ➖ noise
18 datafusion:vortex-compact +7.5% -2.9% +10.7% +16.0% ➖ noise
18 datafusion:vortex-file-compressed +8.5% -2.9% +11.8% +16.0% ➖ noise
18 duckdb:duckdb -0.5% -2.9% +2.5% +16.0% ➖ noise
18 duckdb:vortex-compact +3.1% -2.9% +6.2% +16.0% ➖ noise
18 duckdb:vortex-file-compressed +13.1% -2.9% +16.5% +16.0% 🚨 regression
19 datafusion:arrow -16.7% -11.6% -5.8% +16.0% ➖ noise
19 datafusion:vortex-compact +51.8% -11.6% +71.6% +16.0% 🚨 regression
19 datafusion:vortex-file-compressed +87.2% -11.6% +111.7% +16.0% 🚨 regression
19 duckdb:duckdb -13.0% -11.6% -1.6% +16.6% ➖ noise
19 duckdb:vortex-compact -0.0% -11.6% +13.1% +16.0% ➖ noise
19 duckdb:vortex-file-compressed +4.0% -11.6% +17.6% +19.5% ➖ noise
20 datafusion:arrow -9.3% +10.4% -17.8% +16.0% ✅ faster
20 datafusion:vortex-compact +23.4% +10.4% +11.8% +16.0% ➖ noise
20 datafusion:vortex-file-compressed +34.9% +10.4% +22.2% +16.0% 🚨 regression
20 duckdb:duckdb -1.1% +10.4% -10.4% +16.0% ➖ noise
20 duckdb:vortex-compact +12.7% +10.4% +2.1% +16.0% ➖ noise
20 duckdb:vortex-file-compressed +22.3% +10.4% +10.8% +16.0% ➖ noise
21 datafusion:arrow -3.7% -4.4% +0.8% +16.0% ➖ noise
21 datafusion:vortex-compact +15.4% -4.4% +20.8% +16.0% 🚨 regression
21 datafusion:vortex-file-compressed +22.8% -4.4% +28.5% +16.0% 🚨 regression
21 duckdb:duckdb -2.8% -4.4% +1.8% +16.0% ➖ noise
21 duckdb:vortex-compact +13.9% -4.4% +19.2% +16.0% 🚨 regression
21 duckdb:vortex-file-compressed +9.4% -4.4% +14.5% +16.0% ➖ noise
22 datafusion:arrow -2.6% +0.4% -3.0% +16.0% ➖ noise
22 datafusion:vortex-compact +2.4% +0.4% +2.0% +16.0% ➖ noise
22 datafusion:vortex-file-compressed +9.4% +0.4% +9.0% +16.0% ➖ noise
22 duckdb:duckdb -3.1% +0.4% -3.5% +16.0% ➖ noise
22 duckdb:vortex-compact -7.1% +0.4% -7.5% +16.0% ➖ noise
22 duckdb:vortex-file-compressed -3.4% +0.4% -3.8% +16.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 15, 2026

File Sizes: TPC-H SF=1 on NVME

File Size Changes (18 files changed, +1.2% overall, 13↑ 5↓)
File Scale Format Base HEAD Change %
partsupp_0.vortex 1.0 vortex-file-compressed 35.90 MB 36.90 MB +1.00 MB +2.8%
lineitem_1.vortex 1.0 vortex-file-compressed 84.72 MB 86.32 MB +1.61 MB +1.9%
lineitem_1.vortex 1.0 vortex-compact 62.89 MB 63.80 MB +937.38 KB +1.5%
lineitem_0.vortex 1.0 vortex-compact 62.86 MB 63.76 MB +922.59 KB +1.4%
lineitem_0.vortex 1.0 vortex-file-compressed 85.24 MB 86.32 MB +1.08 MB +1.3%
partsupp_0.vortex 1.0 vortex-compact 25.21 MB 25.42 MB +215.64 KB +0.8%
orders_0.vortex 1.0 vortex-compact 31.68 MB 31.83 MB +157.67 KB +0.5%
part_0.vortex 1.0 vortex-compact 3.62 MB 3.64 MB +15.47 KB +0.4%
part_0.vortex 1.0 vortex-file-compressed 5.42 MB 5.44 MB +18.72 KB +0.3%
customer_0.vortex 1.0 vortex-compact 7.42 MB 7.43 MB +10.05 KB +0.1%
customer_0.vortex 1.0 vortex-file-compressed 10.48 MB 10.49 MB +12.55 KB +0.1%
supplier_0.vortex 1.0 vortex-compact 492.06 KB 492.52 KB +472 B +0.1%
supplier_0.vortex 1.0 vortex-file-compressed 700.42 KB 701.02 KB +608 B +0.1%
orders_0.vortex 1.0 vortex-file-compressed 43.36 MB 42.85 MB 527.91 KB -1.2%
nation_0.vortex 1.0 vortex-file-compressed 8.38 KB 8.17 KB 216 B -2.5%
nation_0.vortex 1.0 vortex-compact 6.30 KB 6.09 KB 216 B -3.3%
region_0.vortex 1.0 vortex-file-compressed 4.78 KB 4.56 KB 224 B -4.6%
region_0.vortex 1.0 vortex-compact 4.52 KB 4.30 KB 224 B -4.8%

Totals:

  • vortex-compact: 194.43 MB → 196.64 MB (+1.1%)
  • vortex-file-compressed: 266.07 MB → 269.28 MB (+1.2%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 15, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: Likely regression (medium confidence)
Attributed Vortex impact: +14.5%
Vortex (geomean): 1.200x ❌
Parquet (geomean): 1.010x ➖
Shifts: Parquet (control) +1.0% · Median polish +9.7%

datafusion / vortex-file-compressed (1.164x ❌, 0↑ 63↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 30211008 27588946 1.10
tpcds_q02/datafusion:vortex-file-compressed 55579336 53298585 1.04
tpcds_q03/datafusion:vortex-file-compressed 🚨 23525943 19856932 1.18
tpcds_q04/datafusion:vortex-file-compressed 🚨 321769712 289587441 1.11
tpcds_q05/datafusion:vortex-file-compressed 🚨 58023409 51794647 1.12
tpcds_q06/datafusion:vortex-file-compressed 54254862 50023856 1.08
tpcds_q07/datafusion:vortex-file-compressed 🚨 69482595 49142212 1.41
tpcds_q08/datafusion:vortex-file-compressed 37534881 35198769 1.07
tpcds_q09/datafusion:vortex-file-compressed 🚨 95744093 58537088 1.64
tpcds_q10/datafusion:vortex-file-compressed 🚨 50911161 43582001 1.17
tpcds_q11/datafusion:vortex-file-compressed 179844556 167516620 1.07
tpcds_q12/datafusion:vortex-file-compressed 23113722 22449819 1.03
tpcds_q13/datafusion:vortex-file-compressed 🚨 90331448 54940958 1.64
tpcds_q14/datafusion:vortex-file-compressed 🚨 227388407 197029596 1.15
tpcds_q15/datafusion:vortex-file-compressed 37046984 34482013 1.07
tpcds_q16/datafusion:vortex-file-compressed 🚨 34615546 28760166 1.20
tpcds_q17/datafusion:vortex-file-compressed 🚨 74281065 66148122 1.12
tpcds_q18/datafusion:vortex-file-compressed 🚨 96950620 80540950 1.20
tpcds_q19/datafusion:vortex-file-compressed 🚨 33537269 28200349 1.19
tpcds_q20/datafusion:vortex-file-compressed 🚨 28259397 25614489 1.10
tpcds_q21/datafusion:vortex-file-compressed 148015539 141293383 1.05
tpcds_q22/datafusion:vortex-file-compressed 🚨 71956687 57458630 1.25
tpcds_q23/datafusion:vortex-file-compressed 🚨 169778118 144133269 1.18
tpcds_q24/datafusion:vortex-file-compressed 🚨 120795701 107766955 1.12
tpcds_q25/datafusion:vortex-file-compressed 🚨 78124604 65128274 1.20
tpcds_q26/datafusion:vortex-file-compressed 🚨 53572796 35909702 1.49
tpcds_q27/datafusion:vortex-file-compressed 🚨 151112637 118960192 1.27
tpcds_q28/datafusion:vortex-file-compressed 🚨 84773517 52727745 1.61
tpcds_q29/datafusion:vortex-file-compressed 🚨 76615790 64345867 1.19
tpcds_q30/datafusion:vortex-file-compressed 28722338 29964851 0.96
tpcds_q31/datafusion:vortex-file-compressed 🚨 108381371 89838680 1.21
tpcds_q32/datafusion:vortex-file-compressed 🚨 25483780 21191343 1.20
tpcds_q33/datafusion:vortex-file-compressed 🚨 45041947 37108285 1.21
tpcds_q34/datafusion:vortex-file-compressed 🚨 33889143 30093363 1.13
tpcds_q35/datafusion:vortex-file-compressed 🚨 59141881 53563154 1.10
tpcds_q36/datafusion:vortex-file-compressed 🚨 85374173 75746412 1.13
tpcds_q37/datafusion:vortex-file-compressed 🚨 57482241 33466444 1.72
tpcds_q38/datafusion:vortex-file-compressed 55598722 51717717 1.08
tpcds_q39/datafusion:vortex-file-compressed 🚨 159219733 138222100 1.15
tpcds_q40/datafusion:vortex-file-compressed 🚨 56165238 50650327 1.11
tpcds_q41/datafusion:vortex-file-compressed 18886015 17916831 1.05
tpcds_q42/datafusion:vortex-file-compressed 🚨 21323745 17168651 1.24
tpcds_q43/datafusion:vortex-file-compressed 34783566 31771874 1.09
tpcds_q44/datafusion:vortex-file-compressed 🚨 60733459 41355203 1.47
tpcds_q45/datafusion:vortex-file-compressed 36267907 34056222 1.06
tpcds_q46/datafusion:vortex-file-compressed 🚨 53400695 48523226 1.10
tpcds_q47/datafusion:vortex-file-compressed 221664412 201936233 1.10
tpcds_q48/datafusion:vortex-file-compressed 🚨 76558809 45806424 1.67
tpcds_q49/datafusion:vortex-file-compressed 🚨 92187057 68207227 1.35
tpcds_q50/datafusion:vortex-file-compressed 🚨 53181741 43741963 1.22
tpcds_q51/datafusion:vortex-file-compressed 95741771 87155974 1.10
tpcds_q52/datafusion:vortex-file-compressed 🚨 21858028 18053405 1.21
tpcds_q53/datafusion:vortex-file-compressed 28061612 25885776 1.08
tpcds_q54/datafusion:vortex-file-compressed 🚨 49063560 43119964 1.14
tpcds_q55/datafusion:vortex-file-compressed 🚨 21405529 17975022 1.19
tpcds_q56/datafusion:vortex-file-compressed 🚨 46496072 39041203 1.19
tpcds_q57/datafusion:vortex-file-compressed 140322012 127725441 1.10
tpcds_q58/datafusion:vortex-file-compressed 🚨 79468010 69861372 1.14
tpcds_q59/datafusion:vortex-file-compressed 77897221 72494178 1.07
tpcds_q60/datafusion:vortex-file-compressed 🚨 45301179 40046468 1.13
tpcds_q61/datafusion:vortex-file-compressed 🚨 57851153 47831110 1.21
tpcds_q62/datafusion:vortex-file-compressed 31569467 31532211 1.00
tpcds_q63/datafusion:vortex-file-compressed 🚨 29069858 25568248 1.14
tpcds_q64/datafusion:vortex-file-compressed 505349510 466660533 1.08
tpcds_q65/datafusion:vortex-file-compressed 🚨 53838391 46261497 1.16
tpcds_q66/datafusion:vortex-file-compressed 94099334 94602405 0.99
tpcds_q67/datafusion:vortex-file-compressed 121030538 120529153 1.00
tpcds_q68/datafusion:vortex-file-compressed 🚨 51266362 43768091 1.17
tpcds_q69/datafusion:vortex-file-compressed 46095781 42457905 1.09
tpcds_q70/datafusion:vortex-file-compressed 119660862 111404544 1.07
tpcds_q71/datafusion:vortex-file-compressed 🚨 38173097 30432391 1.25
tpcds_q72/datafusion:vortex-file-compressed 2636260979 2563360105 1.03
tpcds_q73/datafusion:vortex-file-compressed 34489312 32834516 1.05
tpcds_q74/datafusion:vortex-file-compressed 126922977 117232403 1.08
tpcds_q75/datafusion:vortex-file-compressed 🚨 137936114 119216671 1.16
tpcds_q76/datafusion:vortex-file-compressed 🚨 45638403 34909323 1.31
tpcds_q77/datafusion:vortex-file-compressed 53072022 50083389 1.06
tpcds_q78/datafusion:vortex-file-compressed 🚨 138300042 123273275 1.12
tpcds_q79/datafusion:vortex-file-compressed 🚨 44061046 35543312 1.24
tpcds_q80/datafusion:vortex-file-compressed 124134564 114864731 1.08
tpcds_q81/datafusion:vortex-file-compressed 34067368 37425711 0.91
tpcds_q82/datafusion:vortex-file-compressed 🚨 57535876 35227581 1.63
tpcds_q83/datafusion:vortex-file-compressed 51965549 49881631 1.04
tpcds_q84/datafusion:vortex-file-compressed 15976726 15448681 1.03
tpcds_q85/datafusion:vortex-file-compressed 🚨 122830789 99702350 1.23
tpcds_q86/datafusion:vortex-file-compressed 20397447 19424877 1.05
tpcds_q87/datafusion:vortex-file-compressed 55548019 51744961 1.07
tpcds_q88/datafusion:vortex-file-compressed 🚨 86067535 66730908 1.29
tpcds_q89/datafusion:vortex-file-compressed 🚨 41693823 36506825 1.14
tpcds_q90/datafusion:vortex-file-compressed 🚨 20226125 18025855 1.12
tpcds_q91/datafusion:vortex-file-compressed 🚨 27795523 25240937 1.10
tpcds_q92/datafusion:vortex-file-compressed 🚨 21746629 18610764 1.17
tpcds_q93/datafusion:vortex-file-compressed 🚨 41875123 33656423 1.24
tpcds_q94/datafusion:vortex-file-compressed 🚨 28759807 24967596 1.15
tpcds_q95/datafusion:vortex-file-compressed 67560836 61985956 1.09
tpcds_q96/datafusion:vortex-file-compressed 🚨 19009919 14851454 1.28
tpcds_q97/datafusion:vortex-file-compressed 🚨 36477686 29440909 1.24
tpcds_q98/datafusion:vortex-file-compressed 🚨 36552103 32302099 1.13
tpcds_q99/datafusion:vortex-file-compressed 49658576 46652749 1.06
datafusion / vortex-compact (1.285x ❌, 2↑ 79↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 🚀 27253002 35156270 0.78
tpcds_q02/datafusion:vortex-compact 62529246 59432698 1.05
tpcds_q03/datafusion:vortex-compact 🚨 42284287 25384091 1.67
tpcds_q04/datafusion:vortex-compact 🚨 380697523 326683123 1.17
tpcds_q05/datafusion:vortex-compact 🚨 79574653 64524241 1.23
tpcds_q06/datafusion:vortex-compact 🚨 73307845 55802423 1.31
tpcds_q07/datafusion:vortex-compact 🚨 98014982 65673326 1.49
tpcds_q08/datafusion:vortex-compact 🚨 56607178 44366868 1.28
tpcds_q09/datafusion:vortex-compact 🚨 109294379 72499520 1.51
tpcds_q10/datafusion:vortex-compact 🚨 83472047 63993301 1.30
tpcds_q11/datafusion:vortex-compact 🚨 228595503 187518788 1.22
tpcds_q12/datafusion:vortex-compact 28306445 29161762 0.97
tpcds_q13/datafusion:vortex-compact 🚨 183740438 122890771 1.50
tpcds_q14/datafusion:vortex-compact 🚨 353855996 250427218 1.41
tpcds_q15/datafusion:vortex-compact 39396296 39130085 1.01
tpcds_q16/datafusion:vortex-compact 41205354 38416792 1.07
tpcds_q17/datafusion:vortex-compact 🚨 117626129 92279345 1.27
tpcds_q18/datafusion:vortex-compact 🚨 108442770 88513368 1.23
tpcds_q19/datafusion:vortex-compact 🚨 71764791 43336109 1.66
tpcds_q20/datafusion:vortex-compact 30393996 29872045 1.02
tpcds_q21/datafusion:vortex-compact 🚨 162217155 144144688 1.13
tpcds_q22/datafusion:vortex-compact 🚨 76101179 65230294 1.17
tpcds_q23/datafusion:vortex-compact 🚨 255018081 181428420 1.41
tpcds_q24/datafusion:vortex-compact 🚨 168342870 137472647 1.22
tpcds_q25/datafusion:vortex-compact 🚨 128205416 94864291 1.35
tpcds_q26/datafusion:vortex-compact 🚨 63563866 45888969 1.39
tpcds_q27/datafusion:vortex-compact 🚨 277938007 154224694 1.80
tpcds_q28/datafusion:vortex-compact 🚨 115369142 85313604 1.35
tpcds_q29/datafusion:vortex-compact 🚨 120332779 96313972 1.25
tpcds_q30/datafusion:vortex-compact 30674899 33168619 0.92
tpcds_q31/datafusion:vortex-compact 🚨 182825411 132131569 1.38
tpcds_q32/datafusion:vortex-compact 🚨 29762973 26240161 1.13
tpcds_q33/datafusion:vortex-compact 🚨 73493404 54118190 1.36
tpcds_q34/datafusion:vortex-compact 🚨 69466528 48358769 1.44
tpcds_q35/datafusion:vortex-compact 🚨 83249488 70721069 1.18
tpcds_q36/datafusion:vortex-compact 🚨 182903743 98519367 1.86
tpcds_q37/datafusion:vortex-compact 🚨 65600825 48157690 1.36
tpcds_q38/datafusion:vortex-compact 🚨 78529102 69961541 1.12
tpcds_q39/datafusion:vortex-compact 🚨 180922501 149570735 1.21
tpcds_q40/datafusion:vortex-compact 59905506 57280404 1.05
tpcds_q41/datafusion:vortex-compact 21337250 20439662 1.04
tpcds_q42/datafusion:vortex-compact 🚨 39868373 24497046 1.63
tpcds_q43/datafusion:vortex-compact 🚨 51987050 36971527 1.41
tpcds_q44/datafusion:vortex-compact 🚨 163791557 75123557 2.18
tpcds_q45/datafusion:vortex-compact 42671873 39353599 1.08
tpcds_q46/datafusion:vortex-compact 🚨 96541711 71440065 1.35
tpcds_q47/datafusion:vortex-compact 🚨 317462399 233279510 1.36
tpcds_q48/datafusion:vortex-compact 🚨 155575941 90705656 1.72
tpcds_q49/datafusion:vortex-compact 🚨 123258057 89953773 1.37
tpcds_q50/datafusion:vortex-compact 🚨 91577586 62067081 1.48
tpcds_q51/datafusion:vortex-compact 🚨 117569975 96146072 1.22
tpcds_q52/datafusion:vortex-compact 🚨 39738715 23884507 1.66
tpcds_q53/datafusion:vortex-compact 🚨 62081045 35387474 1.75
tpcds_q54/datafusion:vortex-compact 🚨 76702755 59888875 1.28
tpcds_q55/datafusion:vortex-compact 🚨 39936983 24135660 1.65
tpcds_q56/datafusion:vortex-compact 🚨 75105421 56453282 1.33
tpcds_q57/datafusion:vortex-compact 🚨 152924772 136776205 1.12
tpcds_q58/datafusion:vortex-compact 🚨 101477715 79528594 1.28
tpcds_q59/datafusion:vortex-compact 🚨 114110168 83790725 1.36
tpcds_q60/datafusion:vortex-compact 🚨 74630555 56661143 1.32
tpcds_q61/datafusion:vortex-compact 🚨 130025714 72323622 1.80
tpcds_q62/datafusion:vortex-compact 35170717 33443366 1.05
tpcds_q63/datafusion:vortex-compact 🚨 63813724 35943262 1.78
tpcds_q64/datafusion:vortex-compact 🚨 602830483 538849297 1.12
tpcds_q65/datafusion:vortex-compact 🚨 120590883 67967765 1.77
tpcds_q66/datafusion:vortex-compact 🚨 104804375 94615770 1.11
tpcds_q67/datafusion:vortex-compact 🚨 153157089 125115566 1.22
tpcds_q68/datafusion:vortex-compact 🚨 97372997 70078329 1.39
tpcds_q69/datafusion:vortex-compact 🚨 78746576 62459281 1.26
tpcds_q70/datafusion:vortex-compact 🚨 146403632 123562195 1.18
tpcds_q71/datafusion:vortex-compact 🚨 65581627 46259063 1.42
tpcds_q72/datafusion:vortex-compact 2634121813 2600070898 1.01
tpcds_q73/datafusion:vortex-compact 🚨 71211521 50125610 1.42
tpcds_q74/datafusion:vortex-compact 🚨 173901772 136827473 1.27
tpcds_q75/datafusion:vortex-compact 🚨 202986313 161622951 1.26
tpcds_q76/datafusion:vortex-compact 🚨 83271060 50567356 1.65
tpcds_q77/datafusion:vortex-compact 🚨 79024815 66376960 1.19
tpcds_q78/datafusion:vortex-compact 🚨 179929194 150357803 1.20
tpcds_q79/datafusion:vortex-compact 🚨 87969493 60749678 1.45
tpcds_q80/datafusion:vortex-compact 🚨 169417391 131988785 1.28
tpcds_q81/datafusion:vortex-compact 🚀 34497941 41803109 0.83
tpcds_q82/datafusion:vortex-compact 🚨 67876793 49497784 1.37
tpcds_q83/datafusion:vortex-compact 55354386 56298562 0.98
tpcds_q84/datafusion:vortex-compact 17245604 18656799 0.92
tpcds_q85/datafusion:vortex-compact 🚨 160618429 120463009 1.33
tpcds_q86/datafusion:vortex-compact 24032516 22283330 1.08
tpcds_q87/datafusion:vortex-compact 🚨 78552254 70083567 1.12
tpcds_q88/datafusion:vortex-compact 🚨 243905615 139492421 1.75
tpcds_q89/datafusion:vortex-compact 🚨 74052601 46515993 1.59
tpcds_q90/datafusion:vortex-compact 23431738 24511995 0.96
tpcds_q91/datafusion:vortex-compact 🚨 50564232 39298831 1.29
tpcds_q92/datafusion:vortex-compact 🚨 30938036 25684056 1.20
tpcds_q93/datafusion:vortex-compact 🚨 51890494 44764011 1.16
tpcds_q94/datafusion:vortex-compact 31585292 30686775 1.03
tpcds_q95/datafusion:vortex-compact 74309255 71120800 1.04
tpcds_q96/datafusion:vortex-compact 🚨 38822457 26734076 1.45
tpcds_q97/datafusion:vortex-compact 🚨 55198980 41302228 1.34
tpcds_q98/datafusion:vortex-compact 🚨 51968779 39044577 1.33
tpcds_q99/datafusion:vortex-compact 48688034 47369818 1.03
datafusion / parquet (1.015x ➖, 1↑ 3↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 38474715 36723560 1.05
tpcds_q02/datafusion:parquet 46534527 46708748 1.00
tpcds_q03/datafusion:parquet 14942638 14962246 1.00
tpcds_q04/datafusion:parquet 308828418 312303226 0.99
tpcds_q05/datafusion:parquet 51480706 51282145 1.00
tpcds_q06/datafusion:parquet 65886025 66024499 1.00
tpcds_q07/datafusion:parquet 86918457 84658137 1.03
tpcds_q08/datafusion:parquet 34452754 31977546 1.08
tpcds_q09/datafusion:parquet 58163220 54589980 1.07
tpcds_q10/datafusion:parquet 83825858 80496350 1.04
tpcds_q11/datafusion:parquet 178686099 175545847 1.02
tpcds_q12/datafusion:parquet 23156223 22273339 1.04
tpcds_q13/datafusion:parquet 85262660 83615790 1.02
tpcds_q14/datafusion:parquet 189359642 192354888 0.98
tpcds_q15/datafusion:parquet 25264746 28017694 0.90
tpcds_q16/datafusion:parquet 28782300 29608438 0.97
tpcds_q17/datafusion:parquet 70351474 69226145 1.02
tpcds_q18/datafusion:parquet 132227295 127498004 1.04
tpcds_q19/datafusion:parquet 27630565 27257281 1.01
tpcds_q20/datafusion:parquet 20916495 20695983 1.01
tpcds_q21/datafusion:parquet 21515229 22143148 0.97
tpcds_q22/datafusion:parquet 🚨 163892533 140075023 1.17
tpcds_q23/datafusion:parquet 161436850 160074643 1.01
tpcds_q24/datafusion:parquet 106536540 105420732 1.01
tpcds_q25/datafusion:parquet 70274956 69285270 1.01
tpcds_q26/datafusion:parquet 73645978 75371734 0.98
tpcds_q27/datafusion:parquet 162455905 164168044 0.99
tpcds_q28/datafusion:parquet 48819950 47463594 1.03
tpcds_q29/datafusion:parquet 72392964 71129270 1.02
tpcds_q30/datafusion:parquet 44586634 40693267 1.10
tpcds_q31/datafusion:parquet 75367515 74864989 1.01
tpcds_q32/datafusion:parquet 23266303 21560062 1.08
tpcds_q33/datafusion:parquet 35933436 35516906 1.01
tpcds_q34/datafusion:parquet 26535882 25911851 1.02
tpcds_q35/datafusion:parquet 85497792 79718582 1.07
tpcds_q36/datafusion:parquet 63865434 63208525 1.01
tpcds_q37/datafusion:parquet 23642393 22488900 1.05
tpcds_q38/datafusion:parquet 50169626 49988152 1.00
tpcds_q39/datafusion:parquet 81956685 80959245 1.01
tpcds_q40/datafusion:parquet 27924403 26497614 1.05
tpcds_q41/datafusion:parquet 16090642 15529599 1.04
tpcds_q42/datafusion:parquet 14399422 14021854 1.03
tpcds_q43/datafusion:parquet 🚨 20137386 18151328 1.11
tpcds_q44/datafusion:parquet 42759759 42684708 1.00
tpcds_q45/datafusion:parquet 32590907 33176464 0.98
tpcds_q46/datafusion:parquet 38768219 38425744 1.01
tpcds_q47/datafusion:parquet 133805892 135611916 0.99
tpcds_q48/datafusion:parquet 77426711 77259874 1.00
tpcds_q49/datafusion:parquet 65880670 64015756 1.03
tpcds_q50/datafusion:parquet 47083197 48733322 0.97
tpcds_q51/datafusion:parquet 88068825 87910165 1.00
tpcds_q52/datafusion:parquet 14986009 14354742 1.04
tpcds_q53/datafusion:parquet 20952966 20932608 1.00
tpcds_q54/datafusion:parquet 42928307 42856945 1.00
tpcds_q55/datafusion:parquet 14366577 13774645 1.04
tpcds_q56/datafusion:parquet 35490925 35589904 1.00
tpcds_q57/datafusion:parquet 103991999 104288487 1.00
tpcds_q58/datafusion:parquet 57519810 58235399 0.99
tpcds_q59/datafusion:parquet 58675744 57919734 1.01
tpcds_q60/datafusion:parquet 35271943 34827216 1.01
tpcds_q61/datafusion:parquet 50294763 50716955 0.99
tpcds_q62/datafusion:parquet 🚨 28572326 25046825 1.14
tpcds_q63/datafusion:parquet 21334128 21353114 1.00
tpcds_q64/datafusion:parquet 546511528 539534153 1.01
tpcds_q65/datafusion:parquet 44515575 43614418 1.02
tpcds_q66/datafusion:parquet 74885309 75146878 1.00
tpcds_q67/datafusion:parquet 152246227 153444025 0.99
tpcds_q68/datafusion:parquet 39022281 39521929 0.99
tpcds_q69/datafusion:parquet 77651508 76557637 1.01
tpcds_q70/datafusion:parquet 94663549 97073247 0.98
tpcds_q71/datafusion:parquet 26705230 25874090 1.03
tpcds_q72/datafusion:parquet 643345328 629620362 1.02
tpcds_q73/datafusion:parquet 26837548 25781950 1.04
tpcds_q74/datafusion:parquet 104327554 101623759 1.03
tpcds_q75/datafusion:parquet 117489446 115729621 1.02
tpcds_q76/datafusion:parquet 34489991 35671987 0.97
tpcds_q77/datafusion:parquet 48208456 48566710 0.99
tpcds_q78/datafusion:parquet 121772208 120098733 1.01
tpcds_q79/datafusion:parquet 31575326 31394358 1.01
tpcds_q80/datafusion:parquet 93040863 91591298 1.02
tpcds_q81/datafusion:parquet 39317125 40504419 0.97
tpcds_q82/datafusion:parquet 23809923 23403180 1.02
tpcds_q83/datafusion:parquet 47372013 46930448 1.01
tpcds_q84/datafusion:parquet 47095045 46964744 1.00
tpcds_q85/datafusion:parquet 166987530 165976866 1.01
tpcds_q86/datafusion:parquet 16091949 15986052 1.01
tpcds_q87/datafusion:parquet 51260252 50059983 1.02
tpcds_q88/datafusion:parquet 68292155 68980379 0.99
tpcds_q89/datafusion:parquet 24055143 24610999 0.98
tpcds_q90/datafusion:parquet 18987265 18301189 1.04
tpcds_q91/datafusion:parquet 71010275 69763273 1.02
tpcds_q92/datafusion:parquet 22026035 21822233 1.01
tpcds_q93/datafusion:parquet 35721815 33287487 1.07
tpcds_q94/datafusion:parquet 24886429 25033090 0.99
tpcds_q95/datafusion:parquet 68201283 67721683 1.01
tpcds_q96/datafusion:parquet 14835827 13565999 1.09
tpcds_q97/datafusion:parquet 33852862 32922259 1.03
tpcds_q98/datafusion:parquet 25682683 24674382 1.04
tpcds_q99/datafusion:parquet 🚀 28617455 32367977 0.88
duckdb / vortex-file-compressed (1.120x ❌, 15↑ 55↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 🚀 22213971 25163937 0.88
tpcds_q02/duckdb:vortex-file-compressed 80111288 80892858 0.99
tpcds_q03/duckdb:vortex-file-compressed 🚨 44524281 32454852 1.37
tpcds_q04/duckdb:vortex-file-compressed 🚨 120009926 105629692 1.14
tpcds_q05/duckdb:vortex-file-compressed 🚨 120815415 102860707 1.17
tpcds_q06/duckdb:vortex-file-compressed 34047051 35962695 0.95
tpcds_q07/duckdb:vortex-file-compressed 🚨 35725173 23144596 1.54
tpcds_q08/duckdb:vortex-file-compressed 🚀 23748050 26601547 0.89
tpcds_q09/duckdb:vortex-file-compressed 🚨 56498411 39005577 1.45
tpcds_q10/duckdb:vortex-file-compressed 🚨 44980501 36335169 1.24
tpcds_q11/duckdb:vortex-file-compressed 🚨 71503661 61679946 1.16
tpcds_q12/duckdb:vortex-file-compressed 14361038 14450705 0.99
tpcds_q13/duckdb:vortex-file-compressed 🚨 41257335 32615333 1.26
tpcds_q14/duckdb:vortex-file-compressed 🚨 282565778 203962740 1.39
tpcds_q15/duckdb:vortex-file-compressed 🚀 25572970 40254771 0.64
tpcds_q16/duckdb:vortex-file-compressed 29467588 31311318 0.94
tpcds_q17/duckdb:vortex-file-compressed 37345905 37465403 1.00
tpcds_q18/duckdb:vortex-file-compressed 🚨 52156441 45847647 1.14
tpcds_q19/duckdb:vortex-file-compressed 30491738 31627125 0.96
tpcds_q20/duckdb:vortex-file-compressed 16234633 15520275 1.05
tpcds_q21/duckdb:vortex-file-compressed 🚨 39372159 20972532 1.88
tpcds_q22/duckdb:vortex-file-compressed 96788635 103072488 0.94
tpcds_q23/duckdb:vortex-file-compressed 🚨 175448901 127089225 1.38
tpcds_q24/duckdb:vortex-file-compressed 55270717 53664073 1.03
tpcds_q25/duckdb:vortex-file-compressed 🚨 40788288 35915089 1.14
tpcds_q26/duckdb:vortex-file-compressed 43134612 40487825 1.07
tpcds_q27/duckdb:vortex-file-compressed 🚨 110145125 83303478 1.32
tpcds_q28/duckdb:vortex-file-compressed 🚨 58447555 40598061 1.44
tpcds_q29/duckdb:vortex-file-compressed 37169972 34881507 1.07
tpcds_q30/duckdb:vortex-file-compressed 27200763 29161568 0.93
tpcds_q31/duckdb:vortex-file-compressed 🚨 30053407 25568866 1.18
tpcds_q32/duckdb:vortex-file-compressed 🚨 18643563 16416858 1.14
tpcds_q33/duckdb:vortex-file-compressed 🚨 95143052 64173789 1.48
tpcds_q34/duckdb:vortex-file-compressed 🚨 22134356 18614231 1.19
tpcds_q35/duckdb:vortex-file-compressed 64337554 63899298 1.01
tpcds_q36/duckdb:vortex-file-compressed 27769895 28155021 0.99
tpcds_q37/duckdb:vortex-file-compressed 🚨 37433437 22581603 1.66
tpcds_q38/duckdb:vortex-file-compressed 35065425 36987724 0.95
tpcds_q39/duckdb:vortex-file-compressed 48283670 45575925 1.06
tpcds_q40/duckdb:vortex-file-compressed 🚀 20210005 24862721 0.81
tpcds_q41/duckdb:vortex-file-compressed 14103702 13833405 1.02
tpcds_q42/duckdb:vortex-file-compressed 🚨 15233339 11523749 1.32
tpcds_q43/duckdb:vortex-file-compressed 🚀 20444891 30382134 0.67
tpcds_q44/duckdb:vortex-file-compressed 🚨 30521602 21971207 1.39
tpcds_q45/duckdb:vortex-file-compressed 🚀 20924743 27564355 0.76
tpcds_q46/duckdb:vortex-file-compressed 45524022 46935235 0.97
tpcds_q47/duckdb:vortex-file-compressed 48990822 48289048 1.01
tpcds_q48/duckdb:vortex-file-compressed 🚨 34745743 29391457 1.18
tpcds_q49/duckdb:vortex-file-compressed 🚨 46329399 32302788 1.43
tpcds_q50/duckdb:vortex-file-compressed 🚨 43648355 34458677 1.27
tpcds_q51/duckdb:vortex-file-compressed 107872178 99977673 1.08
tpcds_q52/duckdb:vortex-file-compressed 🚨 16370529 12387192 1.32
tpcds_q53/duckdb:vortex-file-compressed 🚨 20628746 16488598 1.25
tpcds_q54/duckdb:vortex-file-compressed 🚨 75964041 47159479 1.61
tpcds_q55/duckdb:vortex-file-compressed 🚨 17519653 11483361 1.53
tpcds_q56/duckdb:vortex-file-compressed 🚨 94003735 61927687 1.52
tpcds_q57/duckdb:vortex-file-compressed 🚀 33458242 43962502 0.76
tpcds_q58/duckdb:vortex-file-compressed 🚨 44751254 32530554 1.38
tpcds_q59/duckdb:vortex-file-compressed 🚀 49406880 80952748 0.61
tpcds_q60/duckdb:vortex-file-compressed 🚨 97215938 64480218 1.51
tpcds_q61/duckdb:vortex-file-compressed 🚨 48615284 36615984 1.33
tpcds_q62/duckdb:vortex-file-compressed 🚀 15004785 17226862 0.87
tpcds_q63/duckdb:vortex-file-compressed 🚨 20657745 17305200 1.19
tpcds_q64/duckdb:vortex-file-compressed 🚨 118626541 81338233 1.46
tpcds_q65/duckdb:vortex-file-compressed 🚨 26726755 22490989 1.19
tpcds_q66/duckdb:vortex-file-compressed 🚨 71959268 54594898 1.32
tpcds_q67/duckdb:vortex-file-compressed 🚨 161256194 143670419 1.12
tpcds_q68/duckdb:vortex-file-compressed 🚨 45005305 38907398 1.16
tpcds_q69/duckdb:vortex-file-compressed 🚨 46057829 36687799 1.26
tpcds_q70/duckdb:vortex-file-compressed 🚀 25002083 28076577 0.89
tpcds_q71/duckdb:vortex-file-compressed 🚨 27107816 21432890 1.26
tpcds_q72/duckdb:vortex-file-compressed 🚀 149707090 176396470 0.85
tpcds_q73/duckdb:vortex-file-compressed 🚨 25266578 19093491 1.32
tpcds_q74/duckdb:vortex-file-compressed 🚨 57955782 51157800 1.13
tpcds_q75/duckdb:vortex-file-compressed 65784810 61019056 1.08
tpcds_q76/duckdb:vortex-file-compressed 🚨 133110194 67872650 1.96
tpcds_q77/duckdb:vortex-file-compressed 🚨 110167545 64468235 1.71
tpcds_q78/duckdb:vortex-file-compressed 80072797 76182596 1.05
tpcds_q79/duckdb:vortex-file-compressed 🚨 45429612 34677164 1.31
tpcds_q80/duckdb:vortex-file-compressed 🚨 117797657 90225729 1.31
tpcds_q81/duckdb:vortex-file-compressed 🚀 28012838 33856550 0.83
tpcds_q82/duckdb:vortex-file-compressed 🚨 40027830 21920553 1.83
tpcds_q83/duckdb:vortex-file-compressed 🚨 34614868 29288293 1.18
tpcds_q84/duckdb:vortex-file-compressed 19835483 18205764 1.09
tpcds_q85/duckdb:vortex-file-compressed 🚀 40276441 46608476 0.86
tpcds_q86/duckdb:vortex-file-compressed 15604874 16952595 0.92
tpcds_q87/duckdb:vortex-file-compressed 36956130 40329579 0.92
tpcds_q88/duckdb:vortex-file-compressed 🚨 40036892 34525024 1.16
tpcds_q89/duckdb:vortex-file-compressed 🚨 21585300 17280866 1.25
tpcds_q90/duckdb:vortex-file-compressed 13294007 14220924 0.93
tpcds_q91/duckdb:vortex-file-compressed 27010326 29550068 0.91
tpcds_q92/duckdb:vortex-file-compressed 14599579 14432204 1.01
tpcds_q93/duckdb:vortex-file-compressed 🚨 31655062 28349512 1.12
tpcds_q94/duckdb:vortex-file-compressed 🚨 25221788 21900726 1.15
tpcds_q95/duckdb:vortex-file-compressed 🚀 93323419 158886401 0.59
tpcds_q96/duckdb:vortex-file-compressed 🚨 13465662 10470749 1.29
tpcds_q97/duckdb:vortex-file-compressed 40277519 39048946 1.03
tpcds_q98/duckdb:vortex-file-compressed 🚨 21859741 18125512 1.21
tpcds_q99/duckdb:vortex-file-compressed 🚀 19066406 31208867 0.61
duckdb / vortex-compact (1.236x ❌, 19↑ 66↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 🚀 24497069 31294073 0.78
tpcds_q02/duckdb:vortex-compact 🚀 104734563 117785382 0.89
tpcds_q03/duckdb:vortex-compact 🚨 96801289 59190718 1.64
tpcds_q04/duckdb:vortex-compact 🚨 169764654 125295494 1.35
tpcds_q05/duckdb:vortex-compact 🚨 216428382 148342862 1.46
tpcds_q06/duckdb:vortex-compact 🚨 49246157 38751904 1.27
tpcds_q07/duckdb:vortex-compact 🚨 58844593 35532335 1.66
tpcds_q08/duckdb:vortex-compact 37465093 34704477 1.08
tpcds_q09/duckdb:vortex-compact 🚨 71210902 59087202 1.21
tpcds_q10/duckdb:vortex-compact 🚨 69608349 47446474 1.47
tpcds_q11/duckdb:vortex-compact 🚨 105838255 74157813 1.43
tpcds_q12/duckdb:vortex-compact 🚀 17140790 19317921 0.89
tpcds_q13/duckdb:vortex-compact 🚨 76249469 47718334 1.60
tpcds_q14/duckdb:vortex-compact 🚨 398372403 260305055 1.53
tpcds_q15/duckdb:vortex-compact 🚀 27867848 43606925 0.64
tpcds_q16/duckdb:vortex-compact 30240399 33365377 0.91
tpcds_q17/duckdb:vortex-compact 🚨 67090428 47157501 1.42
tpcds_q18/duckdb:vortex-compact 🚨 64129864 55183450 1.16
tpcds_q19/duckdb:vortex-compact 🚨 55134778 39378418 1.40
tpcds_q20/duckdb:vortex-compact 18771600 20256307 0.93
tpcds_q21/duckdb:vortex-compact 🚨 40916474 28089128 1.46
tpcds_q22/duckdb:vortex-compact 🚀 97706232 110186880 0.89
tpcds_q23/duckdb:vortex-compact 🚨 198314511 154288854 1.29
tpcds_q24/duckdb:vortex-compact 🚨 105998504 66281553 1.60
tpcds_q25/duckdb:vortex-compact 🚨 69548955 49740276 1.40
tpcds_q26/duckdb:vortex-compact 53277331 48881062 1.09
tpcds_q27/duckdb:vortex-compact 🚨 167269606 132832792 1.26
tpcds_q28/duckdb:vortex-compact 🚨 95800460 83646555 1.15
tpcds_q29/duckdb:vortex-compact 🚨 64724575 48166368 1.34
tpcds_q30/duckdb:vortex-compact 🚀 28108994 35118453 0.80
tpcds_q31/duckdb:vortex-compact 🚨 46582290 31014210 1.50
tpcds_q32/duckdb:vortex-compact 22105593 23034271 0.96
tpcds_q33/duckdb:vortex-compact 🚨 156210369 127061904 1.23
tpcds_q34/duckdb:vortex-compact 🚨 49027530 25884634 1.89
tpcds_q35/duckdb:vortex-compact 🚨 78703899 68753239 1.14
tpcds_q36/duckdb:vortex-compact 🚨 56695434 35459184 1.60
tpcds_q37/duckdb:vortex-compact 🚨 41522041 32013941 1.30
tpcds_q38/duckdb:vortex-compact 🚨 50845626 41123509 1.24
tpcds_q39/duckdb:vortex-compact 50653561 52572942 0.96
tpcds_q40/duckdb:vortex-compact 🚀 25996627 29379585 0.88
tpcds_q41/duckdb:vortex-compact 16278778 17212279 0.95
tpcds_q42/duckdb:vortex-compact 🚨 30837614 16908740 1.82
tpcds_q43/duckdb:vortex-compact 🚀 32855303 37828069 0.87
tpcds_q44/duckdb:vortex-compact 🚨 67511017 31514052 2.14
tpcds_q45/duckdb:vortex-compact 🚀 24089018 33751479 0.71
tpcds_q46/duckdb:vortex-compact 🚨 72746218 57632641 1.26
tpcds_q47/duckdb:vortex-compact 🚨 78166167 56544001 1.38
tpcds_q48/duckdb:vortex-compact 🚨 70595951 41126671 1.72
tpcds_q49/duckdb:vortex-compact 🚨 64693584 47207603 1.37
tpcds_q50/duckdb:vortex-compact 🚨 116736359 47742659 2.45
tpcds_q51/duckdb:vortex-compact 🚨 148193922 106455290 1.39
tpcds_q52/duckdb:vortex-compact 🚨 30494459 16864579 1.81
tpcds_q53/duckdb:vortex-compact 🚨 46417124 24842277 1.87
tpcds_q54/duckdb:vortex-compact 🚨 103401633 81446840 1.27
tpcds_q55/duckdb:vortex-compact 🚨 29495975 16554876 1.78
tpcds_q56/duckdb:vortex-compact 🚨 152598130 132162386 1.15
tpcds_q57/duckdb:vortex-compact 🚀 33896171 47386449 0.72
tpcds_q58/duckdb:vortex-compact 🚨 88854957 46006211 1.93
tpcds_q59/duckdb:vortex-compact 🚀 82678947 104163420 0.79
tpcds_q60/duckdb:vortex-compact 🚨 155834845 131569862 1.18
tpcds_q61/duckdb:vortex-compact 🚨 102620910 53084174 1.93
tpcds_q62/duckdb:vortex-compact 🚀 17212043 23086078 0.75
tpcds_q63/duckdb:vortex-compact 🚨 46691369 25094176 1.86
tpcds_q64/duckdb:vortex-compact 🚨 148417843 100424045 1.48
tpcds_q65/duckdb:vortex-compact 🚨 52188697 30618215 1.70
tpcds_q66/duckdb:vortex-compact 86337684 93110365 0.93
tpcds_q67/duckdb:vortex-compact 🚨 182454392 150756124 1.21
tpcds_q68/duckdb:vortex-compact 🚨 75142932 50893564 1.48
tpcds_q69/duckdb:vortex-compact 🚨 67509991 47359332 1.43
tpcds_q70/duckdb:vortex-compact 38499160 36404975 1.06
tpcds_q71/duckdb:vortex-compact 🚨 43625352 26813821 1.63
tpcds_q72/duckdb:vortex-compact 🚀 161368829 192546308 0.84
tpcds_q73/duckdb:vortex-compact 🚨 50632327 25329317 2.00
tpcds_q74/duckdb:vortex-compact 🚨 86809073 57259976 1.52
tpcds_q75/duckdb:vortex-compact 🚨 83011990 68741483 1.21
tpcds_q76/duckdb:vortex-compact 🚨 220597515 125620771 1.76
tpcds_q77/duckdb:vortex-compact 🚨 173271239 119648100 1.45
tpcds_q78/duckdb:vortex-compact 🚨 100299383 83627988 1.20
tpcds_q79/duckdb:vortex-compact 🚨 131469092 57384093 2.29
tpcds_q80/duckdb:vortex-compact 🚨 177828177 151127213 1.18
tpcds_q81/duckdb:vortex-compact 🚀 28928779 40065513 0.72
tpcds_q82/duckdb:vortex-compact 🚨 43848319 31607954 1.39
tpcds_q83/duckdb:vortex-compact 🚀 35980466 46473752 0.77
tpcds_q84/duckdb:vortex-compact 21251129 21972123 0.97
tpcds_q85/duckdb:vortex-compact 🚀 53082576 60385555 0.88
tpcds_q86/duckdb:vortex-compact 🚀 17516460 23454204 0.75
tpcds_q87/duckdb:vortex-compact 🚨 53480594 42531329 1.26
tpcds_q88/duckdb:vortex-compact 🚨 63346209 39185752 1.62
tpcds_q89/duckdb:vortex-compact 🚨 47751190 24665372 1.94
tpcds_q90/duckdb:vortex-compact 14452873 15394734 0.94
tpcds_q91/duckdb:vortex-compact 🚨 52534509 45424992 1.16
tpcds_q92/duckdb:vortex-compact 20074245 20730730 0.97
tpcds_q93/duckdb:vortex-compact 33121683 32419866 1.02
tpcds_q94/duckdb:vortex-compact 24454257 24940293 0.98
tpcds_q95/duckdb:vortex-compact 🚀 93975773 154219472 0.61
tpcds_q96/duckdb:vortex-compact 🚨 26882401 13419412 2.00
tpcds_q97/duckdb:vortex-compact 🚨 53198079 41443625 1.28
tpcds_q98/duckdb:vortex-compact 🚨 35888535 24469329 1.47
tpcds_q99/duckdb:vortex-compact 🚀 19909222 32751799 0.61
duckdb / parquet (1.005x ➖, 1↑ 1↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 43713378 42810823 1.02
tpcds_q02/duckdb:parquet 60179423 57357404 1.05
tpcds_q03/duckdb:parquet 12043488 11823748 1.02
tpcds_q04/duckdb:parquet 123778629 126017610 0.98
tpcds_q05/duckdb:parquet 75449442 73400338 1.03
tpcds_q06/duckdb:parquet 29019925 27323900 1.06
tpcds_q07/duckdb:parquet 23325862 23474660 0.99
tpcds_q08/duckdb:parquet 28626822 28262686 1.01
tpcds_q09/duckdb:parquet 39468578 39714898 0.99
tpcds_q10/duckdb:parquet 34587592 33658229 1.03
tpcds_q11/duckdb:parquet 86562401 86727057 1.00
tpcds_q12/duckdb:parquet 13996387 14378064 0.97
tpcds_q13/duckdb:parquet 34396620 33712910 1.02
tpcds_q14/duckdb:parquet 165240682 155425623 1.06
tpcds_q15/duckdb:parquet 30351661 29860853 1.02
tpcds_q16/duckdb:parquet 21825841 21196855 1.03
tpcds_q17/duckdb:parquet 39565591 36943876 1.07
tpcds_q18/duckdb:parquet 46682320 45816568 1.02
tpcds_q19/duckdb:parquet 28584477 29061060 0.98
tpcds_q20/duckdb:parquet 15913961 15120777 1.05
tpcds_q21/duckdb:parquet 11920160 11262954 1.06
tpcds_q22/duckdb:parquet 65446762 69949002 0.94
tpcds_q23/duckdb:parquet 113277739 114975775 0.99
tpcds_q24/duckdb:parquet 45263523 44063053 1.03
tpcds_q25/duckdb:parquet 32519867 32896527 0.99
tpcds_q26/duckdb:parquet 36397308 36534430 1.00
tpcds_q27/duckdb:parquet 88705876 88753935 1.00
tpcds_q28/duckdb:parquet 36787773 36214632 1.02
tpcds_q29/duckdb:parquet 34812699 35627029 0.98
tpcds_q30/duckdb:parquet 40386080 37439755 1.08
tpcds_q31/duckdb:parquet 23857505 23155753 1.03
tpcds_q32/duckdb:parquet 10910304 11527620 0.95
tpcds_q33/duckdb:parquet 69781516 70680176 0.99
tpcds_q34/duckdb:parquet 20917657 20846243 1.00
tpcds_q35/duckdb:parquet 57170972 60322369 0.95
tpcds_q36/duckdb:parquet 20138622 20538367 0.98
tpcds_q37/duckdb:parquet 13212409 13292500 0.99
tpcds_q38/duckdb:parquet 34150730 32757447 1.04
tpcds_q39/duckdb:parquet 32263725 32440728 0.99
tpcds_q40/duckdb:parquet 17313362 17993608 0.96
tpcds_q41/duckdb:parquet 7795967 7421088 1.05
tpcds_q42/duckdb:parquet 10649444 9907501 1.07
tpcds_q43/duckdb:parquet 15935335 15514769 1.03
tpcds_q44/duckdb:parquet 21066898 21632779 0.97
tpcds_q45/duckdb:parquet 26167041 26930254 0.97
tpcds_q46/duckdb:parquet 44263045 44312013 1.00
tpcds_q47/duckdb:parquet 46011453 44470466 1.03
tpcds_q48/duckdb:parquet 29956438 30242344 0.99
tpcds_q49/duckdb:parquet 24476835 24351326 1.01
tpcds_q50/duckdb:parquet 24419596 24696562 0.99
tpcds_q51/duckdb:parquet 94409624 97599244 0.97
tpcds_q52/duckdb:parquet 11111596 10841110 1.02
tpcds_q53/duckdb:parquet 16643189 16124489 1.03
tpcds_q54/duckdb:parquet 40677406 39501985 1.03
tpcds_q55/duckdb:parquet 10077514 10465102 0.96
tpcds_q56/duckdb:parquet 68675742 67716562 1.01
tpcds_q57/duckdb:parquet 35375637 34979262 1.01
tpcds_q58/duckdb:parquet 21224634 21308398 1.00
tpcds_q59/duckdb:parquet 36881265 36938944 1.00
tpcds_q60/duckdb:parquet 70715642 71807712 0.98
tpcds_q61/duckdb:parquet 29651489 30695909 0.97
tpcds_q62/duckdb:parquet 11858293 11535285 1.03
tpcds_q63/duckdb:parquet 14878399 15315299 0.97
tpcds_q64/duckdb:parquet 73825332 73555339 1.00
tpcds_q65/duckdb:parquet 20160363 20674882 0.98
tpcds_q66/duckdb:parquet 🚨 66095866 57524046 1.15
tpcds_q67/duckdb:parquet 133175757 138582874 0.96
tpcds_q68/duckdb:parquet 38314889 37167735 1.03
tpcds_q69/duckdb:parquet 37753380 37533739 1.01
tpcds_q70/duckdb:parquet 20815460 19459116 1.07
tpcds_q71/duckdb:parquet 18655189 19195008 0.97
tpcds_q72/duckdb:parquet 161896430 164383603 0.98
tpcds_q73/duckdb:parquet 18185859 17941564 1.01
tpcds_q74/duckdb:parquet 50202312 48858927 1.03
tpcds_q75/duckdb:parquet 54045143 54375648 0.99
tpcds_q76/duckdb:parquet 70399989 68459759 1.03
tpcds_q77/duckdb:parquet 61768345 62282740 0.99
tpcds_q78/duckdb:parquet 74407172 71868470 1.04
tpcds_q79/duckdb:parquet 27546682 28289753 0.97
tpcds_q80/duckdb:parquet 83037127 82885802 1.00
tpcds_q81/duckdb:parquet 47124297 47073428 1.00
tpcds_q82/duckdb:parquet 15003096 14747164 1.02
tpcds_q83/duckdb:parquet 15737905 15795168 1.00
tpcds_q84/duckdb:parquet 19657594 19563745 1.00
tpcds_q85/duckdb:parquet 40788133 40618809 1.00
tpcds_q86/duckdb:parquet 12389921 11986354 1.03
tpcds_q87/duckdb:parquet 35761131 37839180 0.95
tpcds_q88/duckdb:parquet 28748040 29063191 0.99
tpcds_q89/duckdb:parquet 17021919 17147783 0.99
tpcds_q90/duckdb:parquet 7096124 7833146 0.91
tpcds_q91/duckdb:parquet 22912922 24333061 0.94
tpcds_q92/duckdb:parquet 11248868 11129235 1.01
tpcds_q93/duckdb:parquet 29974029 29908785 1.00
tpcds_q94/duckdb:parquet 16382913 16347609 1.00
tpcds_q95/duckdb:parquet 🚀 119185528 133129111 0.90
tpcds_q96/duckdb:parquet 9347890 9002104 1.04
tpcds_q97/duckdb:parquet 35205799 34259247 1.03
tpcds_q98/duckdb:parquet 18093941 18451478 0.98
tpcds_q99/duckdb:parquet 20246053 19445814 1.04
duckdb / duckdb (0.999x ➖, 1↑ 0↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 19002550 20063094 0.95
tpcds_q02/duckdb:duckdb 18721157 19536594 0.96
tpcds_q03/duckdb:duckdb 8437762 7900177 1.07
tpcds_q04/duckdb:duckdb 162356972 161598072 1.00
tpcds_q05/duckdb:duckdb 17599598 18634826 0.94
tpcds_q06/duckdb:duckdb 22375746 22063354 1.01
tpcds_q07/duckdb:duckdb 38358926 37950956 1.01
tpcds_q08/duckdb:duckdb 120420905 119279287 1.01
tpcds_q09/duckdb:duckdb 19635868 19743324 0.99
tpcds_q10/duckdb:duckdb 23437426 23027072 1.02
tpcds_q11/duckdb:duckdb 140496543 139630882 1.01
tpcds_q12/duckdb:duckdb 11302742 11406097 0.99
tpcds_q13/duckdb:duckdb 23879104 23614965 1.01
tpcds_q14/duckdb:duckdb 91178179 92448607 0.99
tpcds_q15/duckdb:duckdb 24105207 23867714 1.01
tpcds_q16/duckdb:duckdb 17930193 17932180 1.00
tpcds_q17/duckdb:duckdb 20748300 20670318 1.00
tpcds_q18/duckdb:duckdb 43592659 42559320 1.02
tpcds_q19/duckdb:duckdb 16254741 16210824 1.00
tpcds_q20/duckdb:duckdb 11970579 11857265 1.01
tpcds_q21/duckdb:duckdb 6685102 6839934 0.98
tpcds_q22/duckdb:duckdb 60396709 62468506 0.97
tpcds_q23/duckdb:duckdb 78876960 74600628 1.06
tpcds_q24/duckdb:duckdb 23714404 22148733 1.07
tpcds_q25/duckdb:duckdb 16766005 16911767 0.99
tpcds_q26/duckdb:duckdb 25572605 25309750 1.01
tpcds_q27/duckdb:duckdb 37820369 37949936 1.00
tpcds_q28/duckdb:duckdb 21066783 20773514 1.01
tpcds_q29/duckdb:duckdb 20042697 19926146 1.01
tpcds_q30/duckdb:duckdb 28263434 28265134 1.00
tpcds_q31/duckdb:duckdb 19540618 19465640 1.00
tpcds_q32/duckdb:duckdb 6933647 6525867 1.06
tpcds_q33/duckdb:duckdb 12876829 12942506 0.99
tpcds_q34/duckdb:duckdb 14586905 14324353 1.02
tpcds_q35/duckdb:duckdb 31674943 32639071 0.97
tpcds_q36/duckdb:duckdb 67575412 69247190 0.98
tpcds_q37/duckdb:duckdb 7722970 7198947 1.07
tpcds_q38/duckdb:duckdb 31601323 30626232 1.03
tpcds_q39/duckdb:duckdb 24268457 26131798 0.93
tpcds_q40/duckdb:duckdb 13956264 13409327 1.04
tpcds_q41/duckdb:duckdb 8153084 7881697 1.03
tpcds_q42/duckdb:duckdb 6246220 6383102 0.98
tpcds_q43/duckdb:duckdb 10975403 11309827 0.97
tpcds_q44/duckdb:duckdb 12837301 13481433 0.95
tpcds_q45/duckdb:duckdb 16821552 16278677 1.03
tpcds_q46/duckdb:duckdb 35983448 35262510 1.02
tpcds_q47/duckdb:duckdb 40556171 40486662 1.00
tpcds_q48/duckdb:duckdb 21250666 21111946 1.01
tpcds_q49/duckdb:duckdb 16391085 16654589 0.98
tpcds_q50/duckdb:duckdb 13478022 13650262 0.99
tpcds_q51/duckdb:duckdb 93528925 90861927 1.03
tpcds_q52/duckdb:duckdb 7014766 7044924 1.00
tpcds_q53/duckdb:duckdb 11465120 11511498 1.00
tpcds_q54/duckdb:duckdb 16381389 16283751 1.01
tpcds_q55/duckdb:duckdb 6881343 6647061 1.04
tpcds_q56/duckdb:duckdb 13428291 13185864 1.02
tpcds_q57/duckdb:duckdb 31178362 30782171 1.01
tpcds_q58/duckdb:duckdb 12402200 12937085 0.96
tpcds_q59/duckdb:duckdb 33827123 34594788 0.98
tpcds_q60/duckdb:duckdb 14248839 14388494 0.99
tpcds_q61/duckdb:duckdb 13928530 13912820 1.00
tpcds_q62/duckdb:duckdb 9040725 8965344 1.01
tpcds_q63/duckdb:duckdb 11281411 11190764 1.01
tpcds_q64/duckdb:duckdb 51949193 52800842 0.98
tpcds_q65/duckdb:duckdb 30774354 31802059 0.97
tpcds_q66/duckdb:duckdb 24768597 24678905 1.00
tpcds_q67/duckdb:duckdb 126153592 129177492 0.98
tpcds_q68/duckdb:duckdb 24645698 24484690 1.01
tpcds_q69/duckdb:duckdb 22645270 23440203 0.97
tpcds_q70/duckdb:duckdb 14267969 14985739 0.95
tpcds_q71/duckdb:duckdb 🚀 11212262 12879808 0.87
tpcds_q72/duckdb:duckdb 41692288 41279987 1.01
tpcds_q73/duckdb:duckdb 10618781 10685329 0.99
tpcds_q74/duckdb:duckdb 94941091 97881294 0.97
tpcds_q75/duckdb:duckdb 42648980 41130468 1.04
tpcds_q76/duckdb:duckdb 11361109 11626290 0.98
tpcds_q77/duckdb:duckdb 11371502 11655017 0.98
tpcds_q78/duckdb:duckdb 60501268 62646947 0.97
tpcds_q79/duckdb:duckdb 18016665 17343671 1.04
tpcds_q80/duckdb:duckdb 26915235 26124655 1.03
tpcds_q81/duckdb:duckdb 37113526 34638548 1.07
tpcds_q82/duckdb:duckdb 8190759 8112421 1.01
tpcds_q83/duckdb:duckdb 8632755 9294935 0.93
tpcds_q84/duckdb:duckdb 14155038 13164246 1.08
tpcds_q85/duckdb:duckdb 23022152 22316931 1.03
tpcds_q86/duckdb:duckdb 10338795 10334967 1.00
tpcds_q87/duckdb:duckdb 33017578 32599456 1.01
tpcds_q88/duckdb:duckdb 23848443 23963761 1.00
tpcds_q89/duckdb:duckdb 12708722 13421496 0.95
tpcds_q90/duckdb:duckdb 5447269 5497124 0.99
tpcds_q91/duckdb:duckdb 12455303 12806331 0.97
tpcds_q92/duckdb:duckdb 8315608 8448098 0.98
tpcds_q93/duckdb:duckdb 21210935 21708652 0.98
tpcds_q94/duckdb:duckdb 13171014 12301556 1.07
tpcds_q95/duckdb:duckdb 116324010 123375236 0.94
tpcds_q96/duckdb:duckdb 4348619 4491690 0.97
tpcds_q97/duckdb:duckdb 30260719 29276132 1.03
tpcds_q98/duckdb:duckdb 13106978 12634836 1.04
tpcds_q99/duckdb:duckdb 15816465 16232878 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -22.5% +3.4% -25.1% +13.1% ✅ faster
1 datafusion:vortex-file-compressed +9.5% +3.4% +5.9% +13.6% ➖ noise
1 duckdb:duckdb -5.3% +3.4% -8.4% +15.8% ➖ noise
1 duckdb:vortex-compact -21.7% +3.4% -24.3% +22.5% ✅ faster
1 duckdb:vortex-file-compressed -11.7% +3.4% -14.7% +20.0% ➖ noise
2 datafusion:vortex-compact +5.2% +2.2% +2.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +4.3% +2.2% +2.0% +10.0% ➖ noise
2 duckdb:duckdb -4.2% +2.2% -6.3% +11.2% ➖ noise
2 duckdb:vortex-compact -11.1% +2.2% -13.0% +10.0% ✅ faster
2 duckdb:vortex-file-compressed -1.0% +2.2% -3.1% +10.2% ➖ noise
3 datafusion:vortex-compact +66.6% +0.9% +65.2% +10.0% 🚨 regression
3 datafusion:vortex-file-compressed +18.5% +0.9% +17.5% +10.0% 🚨 regression
3 duckdb:duckdb +6.8% +0.9% +5.9% +15.9% ➖ noise
3 duckdb:vortex-compact +63.5% +0.9% +62.1% +10.0% 🚨 regression
3 duckdb:vortex-file-compressed +37.2% +0.9% +36.0% +11.3% 🚨 regression
4 datafusion:vortex-compact +16.5% -1.4% +18.2% +10.0% 🚨 regression
4 datafusion:vortex-file-compressed +11.1% -1.4% +12.7% +10.0% 🚨 regression
4 duckdb:duckdb +0.5% -1.4% +1.9% +10.0% ➖ noise
4 duckdb:vortex-compact +35.5% -1.4% +37.5% +10.0% 🚨 regression
4 duckdb:vortex-file-compressed +13.6% -1.4% +15.3% +10.0% 🚨 regression
5 datafusion:vortex-compact +23.3% +1.6% +21.4% +11.8% 🚨 regression
5 datafusion:vortex-file-compressed +12.0% +1.6% +10.3% +11.2% ➖ noise
5 duckdb:duckdb -5.6% +1.6% -7.0% +10.0% ➖ noise
5 duckdb:vortex-compact +45.9% +1.6% +43.6% +10.6% 🚨 regression
5 duckdb:vortex-file-compressed +17.5% +1.6% +15.6% +10.0% 🚨 regression
6 datafusion:vortex-compact +31.4% +2.9% +27.6% +10.0% 🚨 regression
6 datafusion:vortex-file-compressed +8.5% +2.9% +5.4% +10.0% ➖ noise
6 duckdb:duckdb +1.4% +2.9% -1.5% +14.5% ➖ noise
6 duckdb:vortex-compact +27.1% +2.9% +23.4% +12.2% 🚨 regression
6 duckdb:vortex-file-compressed -5.3% +2.9% -8.0% +10.0% ➖ noise
7 datafusion:vortex-compact +49.2% +1.0% +47.8% +10.0% 🚨 regression
7 datafusion:vortex-file-compressed +41.4% +1.0% +40.0% +10.0% 🚨 regression
7 duckdb:duckdb +1.1% +1.0% +0.1% +18.1% ➖ noise
7 duckdb:vortex-compact +65.6% +1.0% +64.0% +10.0% 🚨 regression
7 duckdb:vortex-file-compressed +54.4% +1.0% +52.8% +11.1% 🚨 regression
8 datafusion:vortex-compact +27.6% +4.5% +22.1% +10.0% 🚨 regression
8 datafusion:vortex-file-compressed +6.6% +4.5% +2.1% +10.0% ➖ noise
8 duckdb:duckdb +1.0% +4.5% -3.4% +10.0% ➖ noise
8 duckdb:vortex-compact +8.0% +4.5% +3.3% +16.2% ➖ noise
8 duckdb:vortex-file-compressed -10.7% +4.5% -14.5% +17.5% ➖ noise
9 datafusion:vortex-compact +50.8% +2.9% +46.5% +10.0% 🚨 regression
9 datafusion:vortex-file-compressed +63.6% +2.9% +59.0% +10.0% 🚨 regression
9 duckdb:duckdb -0.5% +2.9% -3.3% +10.0% ➖ noise
9 duckdb:vortex-compact +20.5% +2.9% +17.1% +10.0% 🚨 regression
9 duckdb:vortex-file-compressed +44.8% +2.9% +40.8% +10.0% 🚨 regression
10 datafusion:vortex-compact +30.4% +3.4% +26.1% +10.0% 🚨 regression
10 datafusion:vortex-file-compressed +16.8% +3.4% +12.9% +10.0% 🚨 regression
10 duckdb:duckdb +1.8% +3.4% -1.6% +10.0% ➖ noise
10 duckdb:vortex-compact +46.7% +3.4% +41.8% +10.0% 🚨 regression
10 duckdb:vortex-file-compressed +23.8% +3.4% +19.7% +10.0% 🚨 regression
11 datafusion:vortex-compact +21.9% +0.8% +20.9% +10.0% 🚨 regression
11 datafusion:vortex-file-compressed +7.4% +0.8% +6.5% +10.0% ➖ noise
11 duckdb:duckdb +0.6% +0.8% -0.2% +10.0% ➖ noise
11 duckdb:vortex-compact +42.7% +0.8% +41.6% +10.0% 🚨 regression
11 duckdb:vortex-file-compressed +15.9% +0.8% +15.0% +10.0% 🚨 regression
12 datafusion:vortex-compact -2.9% +0.6% -3.5% +15.0% ➖ noise
12 datafusion:vortex-file-compressed +3.0% +0.6% +2.3% +10.0% ➖ noise
12 duckdb:duckdb -0.9% +0.6% -1.5% +10.0% ➖ noise
12 duckdb:vortex-compact -11.3% +0.6% -11.8% +12.8% ✅ faster
12 duckdb:vortex-file-compressed -0.6% +0.6% -1.2% +10.0% ➖ noise
13 datafusion:vortex-compact +49.5% +2.0% +46.6% +10.0% 🚨 regression
13 datafusion:vortex-file-compressed +64.4% +2.0% +61.2% +10.0% 🚨 regression
13 duckdb:duckdb +1.1% +2.0% -0.9% +10.0% ➖ noise
13 duckdb:vortex-compact +59.8% +2.0% +56.7% +10.0% 🚨 regression
13 duckdb:vortex-file-compressed +26.5% +2.0% +24.0% +10.0% 🚨 regression
14 datafusion:vortex-compact +41.3% +2.3% +38.1% +10.0% 🚨 regression
14 datafusion:vortex-file-compressed +15.4% +2.3% +12.8% +10.0% 🚨 regression
14 duckdb:duckdb -1.4% +2.3% -3.6% +10.0% ➖ noise
14 duckdb:vortex-compact +53.0% +2.3% +49.6% +10.0% 🚨 regression
14 duckdb:vortex-file-compressed +38.5% +2.3% +35.4% +11.1% 🚨 regression
15 datafusion:vortex-compact +0.7% -4.3% +5.2% +13.7% ➖ noise
15 datafusion:vortex-file-compressed +7.4% -4.3% +12.2% +10.0% 🚨 regression
15 duckdb:duckdb +1.0% -4.3% +5.5% +14.0% ➖ noise
15 duckdb:vortex-compact -36.1% -4.3% -33.2% +19.9% ✅ faster
15 duckdb:vortex-file-compressed -36.5% -4.3% -33.6% +21.6% ✅ faster
16 datafusion:vortex-compact +7.3% +0.0% +7.2% +10.7% ➖ noise
16 datafusion:vortex-file-compressed +20.4% +0.0% +20.3% +10.0% 🚨 regression
16 duckdb:duckdb -0.0% +0.0% -0.1% +17.4% ➖ noise
16 duckdb:vortex-compact -9.4% +0.0% -9.4% +14.2% ➖ noise
16 duckdb:vortex-file-compressed -5.9% +0.0% -5.9% +10.9% ➖ noise
17 datafusion:vortex-compact +27.5% +4.3% +22.2% +10.0% 🚨 regression
17 datafusion:vortex-file-compressed +12.3% +4.3% +7.6% +10.0% ➖ noise
17 duckdb:duckdb +0.4% +4.3% -3.8% +10.0% ➖ noise
17 duckdb:vortex-compact +42.3% +4.3% +36.4% +10.0% 🚨 regression
17 duckdb:vortex-file-compressed -0.3% +4.3% -4.5% +10.0% ➖ noise
18 datafusion:vortex-compact +22.5% +2.8% +19.2% +10.0% 🚨 regression
18 datafusion:vortex-file-compressed +20.4% +2.8% +17.1% +10.0% 🚨 regression
18 duckdb:duckdb +2.4% +2.8% -0.4% +10.0% ➖ noise
18 duckdb:vortex-compact +16.2% +2.8% +13.1% +10.5% 🚨 regression
18 duckdb:vortex-file-compressed +13.8% +2.8% +10.7% +10.0% 🚨 regression
19 datafusion:vortex-compact +65.6% -0.1% +65.8% +10.0% 🚨 regression
19 datafusion:vortex-file-compressed +18.9% -0.1% +19.1% +10.0% 🚨 regression
19 duckdb:duckdb +0.3% -0.1% +0.4% +11.6% ➖ noise
19 duckdb:vortex-compact +40.0% -0.1% +40.2% +10.0% 🚨 regression
19 duckdb:vortex-file-compressed -3.6% -0.1% -3.4% +10.0% ➖ noise
20 datafusion:vortex-compact +1.7% +3.1% -1.3% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +10.3% +3.1% +7.0% +10.0% ➖ noise
20 duckdb:duckdb +1.0% +3.1% -2.1% +10.3% ➖ noise
20 duckdb:vortex-compact -7.3% +3.1% -10.1% +13.8% ➖ noise
20 duckdb:vortex-file-compressed +4.6% +3.1% +1.4% +13.6% ➖ noise
21 datafusion:vortex-compact +12.5% +1.4% +11.0% +12.8% ➖ noise
21 datafusion:vortex-file-compressed +4.8% +1.4% +3.3% +12.4% ➖ noise
21 duckdb:duckdb -2.3% +1.4% -3.6% +22.6% ➖ noise
21 duckdb:vortex-compact +45.7% +1.4% +43.6% +13.7% 🚨 regression
21 duckdb:vortex-file-compressed +87.7% +1.4% +85.1% +13.2% 🚨 regression
22 datafusion:vortex-compact +16.7% +4.6% +11.5% +10.8% 🚨 regression
22 datafusion:vortex-file-compressed +25.2% +4.6% +19.7% +17.0% 🚨 regression
22 duckdb:duckdb -3.3% +4.6% -7.6% +13.4% ➖ noise
22 duckdb:vortex-compact -11.3% +4.6% -15.2% +10.8% ✅ faster
22 duckdb:vortex-file-compressed -6.1% +4.6% -10.3% +13.1% ➖ noise
23 datafusion:vortex-compact +40.6% -0.3% +41.0% +10.0% 🚨 regression
23 datafusion:vortex-file-compressed +17.8% -0.3% +18.2% +10.0% 🚨 regression
23 duckdb:duckdb +5.7% -0.3% +6.1% +18.5% ➖ noise
23 duckdb:vortex-compact +28.5% -0.3% +28.9% +11.2% 🚨 regression
23 duckdb:vortex-file-compressed +38.1% -0.3% +38.5% +11.5% 🚨 regression
24 datafusion:vortex-compact +22.5% +1.9% +20.2% +10.0% 🚨 regression
24 datafusion:vortex-file-compressed +12.1% +1.9% +10.0% +10.0% 🚨 regression
24 duckdb:duckdb +7.1% +1.9% +5.1% +10.0% ➖ noise
24 duckdb:vortex-compact +59.9% +1.9% +57.0% +10.0% 🚨 regression
24 duckdb:vortex-file-compressed +3.0% +1.9% +1.1% +11.5% ➖ noise
25 datafusion:vortex-compact +35.1% +0.1% +35.0% +10.0% 🚨 regression
25 datafusion:vortex-file-compressed +20.0% +0.1% +19.8% +10.0% 🚨 regression
25 duckdb:duckdb -0.9% +0.1% -1.0% +10.0% ➖ noise
25 duckdb:vortex-compact +39.8% +0.1% +39.6% +10.0% 🚨 regression
25 duckdb:vortex-file-compressed +13.6% +0.1% +13.4% +10.0% 🚨 regression
26 datafusion:vortex-compact +38.5% -1.3% +40.4% +10.0% 🚨 regression
26 datafusion:vortex-file-compressed +49.2% -1.3% +51.2% +10.0% 🚨 regression
26 duckdb:duckdb +1.0% -1.3% +2.4% +10.0% ➖ noise
26 duckdb:vortex-compact +9.0% -1.3% +10.5% +10.0% 🚨 regression
26 duckdb:vortex-file-compressed +6.5% -1.3% +8.0% +10.5% ➖ noise
27 datafusion:vortex-compact +80.2% -0.5% +81.2% +10.0% 🚨 regression
27 datafusion:vortex-file-compressed +27.0% -0.5% +27.7% +10.0% 🚨 regression
27 duckdb:duckdb -0.3% -0.5% +0.2% +15.1% ➖ noise
27 duckdb:vortex-compact +25.9% -0.5% +26.6% +10.0% 🚨 regression
27 duckdb:vortex-file-compressed +32.2% -0.5% +33.0% +10.0% 🚨 regression
28 datafusion:vortex-compact +35.2% +2.2% +32.3% +10.0% 🚨 regression
28 datafusion:vortex-file-compressed +60.8% +2.2% +57.3% +10.0% 🚨 regression
28 duckdb:duckdb +1.4% +2.2% -0.8% +10.0% ➖ noise
28 duckdb:vortex-compact +14.5% +2.2% +12.0% +10.0% 🚨 regression
28 duckdb:vortex-file-compressed +44.0% +2.2% +40.8% +10.0% 🚨 regression
29 datafusion:vortex-compact +24.9% -0.3% +25.3% +10.0% 🚨 regression
29 datafusion:vortex-file-compressed +19.1% -0.3% +19.4% +10.0% 🚨 regression
29 duckdb:duckdb +0.6% -0.3% +0.9% +10.4% ➖ noise
29 duckdb:vortex-compact +34.4% -0.3% +34.7% +10.0% 🚨 regression
29 duckdb:vortex-file-compressed +6.6% -0.3% +6.9% +12.9% ➖ noise
30 datafusion:vortex-compact -7.5% +8.7% -14.9% +12.8% ✅ faster
30 datafusion:vortex-file-compressed -4.1% +8.7% -11.8% +10.0% ✅ faster
30 duckdb:duckdb -0.0% +8.7% -8.0% +11.1% ➖ noise
30 duckdb:vortex-compact -20.0% +8.7% -26.4% +11.5% ✅ faster
30 duckdb:vortex-file-compressed -6.7% +8.7% -14.2% +10.0% ✅ faster
31 datafusion:vortex-compact +38.4% +1.8% +35.9% +10.0% 🚨 regression
31 datafusion:vortex-file-compressed +20.6% +1.8% +18.5% +10.0% 🚨 regression
31 duckdb:duckdb +0.4% +1.8% -1.4% +13.5% ➖ noise
31 duckdb:vortex-compact +50.2% +1.8% +47.5% +12.1% 🚨 regression
31 duckdb:vortex-file-compressed +17.5% +1.8% +15.4% +10.0% 🚨 regression
32 datafusion:vortex-compact +13.4% +1.1% +12.2% +10.0% 🚨 regression
32 datafusion:vortex-file-compressed +20.3% +1.1% +19.0% +10.0% 🚨 regression
32 duckdb:duckdb +6.2% +1.1% +5.1% +22.2% ➖ noise
32 duckdb:vortex-compact -4.0% +1.1% -5.0% +12.9% ➖ noise
32 duckdb:vortex-file-compressed +13.6% +1.1% +12.4% +10.0% 🚨 regression
33 datafusion:vortex-compact +35.8% -0.1% +35.9% +10.0% 🚨 regression
33 datafusion:vortex-file-compressed +21.4% -0.1% +21.4% +10.0% 🚨 regression
33 duckdb:duckdb -0.5% -0.1% -0.5% +10.3% ➖ noise
33 duckdb:vortex-compact +22.9% -0.1% +23.0% +10.0% 🚨 regression
33 duckdb:vortex-file-compressed +48.3% -0.1% +48.3% +10.3% 🚨 regression
34 datafusion:vortex-compact +43.6% +1.4% +41.7% +10.0% 🚨 regression
34 datafusion:vortex-file-compressed +12.6% +1.4% +11.1% +10.0% 🚨 regression
34 duckdb:duckdb +1.8% +1.4% +0.5% +10.2% ➖ noise
34 duckdb:vortex-compact +89.4% +1.4% +86.8% +10.0% 🚨 regression
34 duckdb:vortex-file-compressed +18.9% +1.4% +17.3% +12.3% 🚨 regression
35 datafusion:vortex-compact +17.7% +0.8% +16.8% +10.0% 🚨 regression
35 datafusion:vortex-file-compressed +10.4% +0.8% +9.5% +10.0% ➖ noise
35 duckdb:duckdb -3.0% +0.8% -3.7% +17.2% ➖ noise
35 duckdb:vortex-compact +14.5% +0.8% +13.5% +10.0% 🚨 regression
35 duckdb:vortex-file-compressed +0.7% +0.8% -0.1% +10.1% ➖ noise
36 datafusion:vortex-compact +85.7% -0.5% +86.5% +13.4% 🚨 regression
36 datafusion:vortex-file-compressed +12.7% -0.5% +13.2% +14.2% ➖ noise
36 duckdb:duckdb -2.4% -0.5% -2.0% +14.7% ➖ noise
36 duckdb:vortex-compact +59.9% -0.5% +60.6% +12.5% 🚨 regression
36 duckdb:vortex-file-compressed -1.4% -0.5% -0.9% +15.1% ➖ noise
37 datafusion:vortex-compact +36.2% +2.2% +33.3% +10.0% 🚨 regression
37 datafusion:vortex-file-compressed +71.8% +2.2% +68.0% +13.7% 🚨 regression
37 duckdb:duckdb +7.3% +2.2% +4.9% +18.6% ➖ noise
37 duckdb:vortex-compact +29.7% +2.2% +26.9% +11.2% 🚨 regression
37 duckdb:vortex-file-compressed +65.8% +2.2% +62.2% +10.8% 🚨 regression
38 datafusion:vortex-compact +12.2% +2.3% +9.7% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +7.5% +2.3% +5.1% +10.0% ➖ noise
38 duckdb:duckdb +3.2% +2.3% +0.9% +15.4% ➖ noise
38 duckdb:vortex-compact +23.6% +2.3% +20.9% +11.7% 🚨 regression
38 duckdb:vortex-file-compressed -5.2% +2.3% -7.3% +12.4% ➖ noise
39 datafusion:vortex-compact +21.0% +0.3% +20.6% +12.8% 🚨 regression
39 datafusion:vortex-file-compressed +15.2% +0.3% +14.8% +19.4% ➖ noise
39 duckdb:duckdb -7.1% +0.3% -7.4% +29.3% ➖ noise
39 duckdb:vortex-compact -3.7% +0.3% -4.0% +12.3% ➖ noise
39 duckdb:vortex-file-compressed +5.9% +0.3% +5.6% +11.5% ➖ noise
40 datafusion:vortex-compact +4.6% +0.7% +3.9% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +10.9% +0.7% +10.1% +10.0% 🚨 regression
40 duckdb:duckdb +4.1% +0.7% +3.4% +14.5% ➖ noise
40 duckdb:vortex-compact -11.5% +0.7% -12.1% +21.9% ➖ noise
40 duckdb:vortex-file-compressed -18.7% +0.7% -19.3% +10.2% ✅ faster
41 datafusion:vortex-compact +4.4% +4.3% +0.1% +12.5% ➖ noise
41 datafusion:vortex-file-compressed +5.4% +4.3% +1.0% +17.0% ➖ noise
41 duckdb:duckdb +3.4% +4.3% -0.8% +13.8% ➖ noise
41 duckdb:vortex-compact -5.4% +4.3% -9.3% +11.8% ➖ noise
41 duckdb:vortex-file-compressed +2.0% +4.3% -2.3% +11.0% ➖ noise
42 datafusion:vortex-compact +62.7% +5.1% +54.9% +10.3% 🚨 regression
42 datafusion:vortex-file-compressed +24.2% +5.1% +18.2% +14.2% 🚨 regression
42 duckdb:duckdb -2.1% +5.1% -6.9% +13.5% ➖ noise
42 duckdb:vortex-compact +82.4% +5.1% +73.6% +13.9% 🚨 regression
42 duckdb:vortex-file-compressed +32.2% +5.1% +25.8% +29.0% ➖ noise
43 datafusion:vortex-compact +40.6% +6.7% +31.7% +10.0% 🚨 regression
43 datafusion:vortex-file-compressed +9.5% +6.7% +2.6% +10.0% ➖ noise
43 duckdb:duckdb -3.0% +6.7% -9.1% +11.5% ➖ noise
43 duckdb:vortex-compact -13.1% +6.7% -18.6% +10.0% ✅ faster
43 duckdb:vortex-file-compressed -32.7% +6.7% -37.0% +15.8% ✅ faster
44 datafusion:vortex-compact +118.0% -1.2% +120.7% +10.0% 🚨 regression
44 datafusion:vortex-file-compressed +46.9% -1.2% +48.7% +10.0% 🚨 regression
44 duckdb:duckdb -4.8% -1.2% -3.6% +15.7% ➖ noise
44 duckdb:vortex-compact +114.2% -1.2% +116.9% +10.0% 🚨 regression
44 duckdb:vortex-file-compressed +38.9% -1.2% +40.6% +10.0% 🚨 regression
45 datafusion:vortex-compact +8.4% -2.3% +11.0% +10.0% 🚨 regression
45 datafusion:vortex-file-compressed +6.5% -2.3% +9.0% +10.0% ➖ noise
45 duckdb:duckdb +3.3% -2.3% +5.8% +10.0% ➖ noise
45 duckdb:vortex-compact -28.6% -2.3% -26.9% +10.9% ✅ faster
45 duckdb:vortex-file-compressed -24.1% -2.3% -22.3% +10.4% ✅ faster
46 datafusion:vortex-compact +35.1% +0.4% +34.6% +10.0% 🚨 regression
46 datafusion:vortex-file-compressed +10.1% +0.4% +9.6% +10.0% ➖ noise
46 duckdb:duckdb +2.0% +0.4% +1.6% +10.0% ➖ noise
46 duckdb:vortex-compact +26.2% +0.4% +25.7% +10.0% 🚨 regression
46 duckdb:vortex-file-compressed -3.0% +0.4% -3.4% +10.0% ➖ noise
47 datafusion:vortex-compact +36.1% +1.0% +34.7% +10.0% 🚨 regression
47 datafusion:vortex-file-compressed +9.8% +1.0% +8.6% +10.0% ➖ noise
47 duckdb:duckdb +0.2% +1.0% -0.9% +10.0% ➖ noise
47 duckdb:vortex-compact +38.2% +1.0% +36.8% +10.0% 🚨 regression
47 duckdb:vortex-file-compressed +1.5% +1.0% +0.4% +10.0% ➖ noise
48 datafusion:vortex-compact +71.5% -0.4% +72.1% +10.0% 🚨 regression
48 datafusion:vortex-file-compressed +67.1% -0.4% +67.8% +10.0% 🚨 regression
48 duckdb:duckdb +0.7% -0.4% +1.0% +10.0% ➖ noise
48 duckdb:vortex-compact +71.7% -0.4% +72.3% +10.0% 🚨 regression
48 duckdb:vortex-file-compressed +18.2% -0.4% +18.7% +11.9% 🚨 regression
49 datafusion:vortex-compact +37.0% +1.7% +34.7% +10.0% 🚨 regression
49 datafusion:vortex-file-compressed +35.2% +1.7% +32.9% +10.0% 🚨 regression
49 duckdb:duckdb -1.6% +1.7% -3.2% +17.1% ➖ noise
49 duckdb:vortex-compact +37.0% +1.7% +34.7% +11.1% 🚨 regression
49 duckdb:vortex-file-compressed +43.4% +1.7% +41.0% +18.8% 🚨 regression
50 datafusion:vortex-compact +47.5% -2.3% +51.0% +10.0% 🚨 regression
50 datafusion:vortex-file-compressed +21.6% -2.3% +24.4% +10.0% 🚨 regression
50 duckdb:duckdb -1.3% -2.3% +1.0% +12.4% ➖ noise
50 duckdb:vortex-compact +144.5% -2.3% +150.2% +10.0% 🚨 regression
50 duckdb:vortex-file-compressed +26.7% -2.3% +29.6% +10.0% 🚨 regression
51 datafusion:vortex-compact +22.3% -1.6% +24.2% +11.8% 🚨 regression
51 datafusion:vortex-file-compressed +9.9% -1.6% +11.6% +11.2% 🚨 regression
51 duckdb:duckdb +2.9% -1.6% +4.6% +20.8% ➖ noise
51 duckdb:vortex-compact +39.2% -1.6% +41.4% +21.9% 🚨 regression
51 duckdb:vortex-file-compressed +7.9% -1.6% +9.6% +13.6% ➖ noise
52 datafusion:vortex-compact +66.4% +3.4% +60.8% +12.2% 🚨 regression
52 datafusion:vortex-file-compressed +21.1% +3.4% +17.0% +13.2% 🚨 regression
52 duckdb:duckdb -0.4% +3.4% -3.7% +18.3% ➖ noise
52 duckdb:vortex-compact +80.8% +3.4% +74.8% +14.3% 🚨 regression
52 duckdb:vortex-file-compressed +32.2% +3.4% +27.8% +21.7% 🚨 regression
53 datafusion:vortex-compact +75.4% +1.6% +72.6% +10.7% 🚨 regression
53 datafusion:vortex-file-compressed +8.4% +1.6% +6.7% +10.0% ➖ noise
53 duckdb:duckdb -0.4% +1.6% -2.0% +10.9% ➖ noise
53 duckdb:vortex-compact +86.8% +1.6% +83.8% +10.0% 🚨 regression
53 duckdb:vortex-file-compressed +25.1% +1.6% +23.1% +10.0% 🚨 regression
54 datafusion:vortex-compact +28.1% +1.6% +26.1% +10.0% 🚨 regression
54 datafusion:vortex-file-compressed +13.8% +1.6% +12.0% +10.0% 🚨 regression
54 duckdb:duckdb +0.6% +1.6% -0.9% +12.0% ➖ noise
54 duckdb:vortex-compact +27.0% +1.6% +25.0% +10.0% 🚨 regression
54 duckdb:vortex-file-compressed +61.1% +1.6% +58.6% +11.6% 🚨 regression
55 datafusion:vortex-compact +65.5% +0.2% +65.1% +11.0% 🚨 regression
55 datafusion:vortex-file-compressed +19.1% +0.2% +18.8% +12.8% 🚨 regression
55 duckdb:duckdb +3.5% +0.2% +3.3% +14.3% ➖ noise
55 duckdb:vortex-compact +78.2% +0.2% +77.8% +15.9% 🚨 regression
55 duckdb:vortex-file-compressed +52.6% +0.2% +52.2% +19.8% 🚨 regression
56 datafusion:vortex-compact +33.0% +0.6% +32.3% +10.0% 🚨 regression
56 datafusion:vortex-file-compressed +19.1% +0.6% +18.4% +10.0% 🚨 regression
56 duckdb:duckdb +1.8% +0.6% +1.3% +13.7% ➖ noise
56 duckdb:vortex-compact +15.5% +0.6% +14.8% +10.0% 🚨 regression
56 duckdb:vortex-file-compressed +51.8% +0.6% +50.9% +10.0% 🚨 regression
57 datafusion:vortex-compact +11.8% +0.4% +11.3% +10.0% 🚨 regression
57 datafusion:vortex-file-compressed +9.9% +0.4% +9.4% +10.0% ➖ noise
57 duckdb:duckdb +1.3% +0.4% +0.9% +16.4% ➖ noise
57 duckdb:vortex-compact -28.5% +0.4% -28.8% +10.0% ✅ faster
57 duckdb:vortex-file-compressed -23.9% +0.4% -24.2% +13.0% ✅ faster
58 datafusion:vortex-compact +27.6% -0.8% +28.6% +10.0% 🚨 regression
58 datafusion:vortex-file-compressed +13.8% -0.8% +14.7% +10.0% 🚨 regression
58 duckdb:duckdb -4.1% -0.8% -3.3% +14.6% ➖ noise
58 duckdb:vortex-compact +93.1% -0.8% +94.7% +11.5% 🚨 regression
58 duckdb:vortex-file-compressed +37.6% -0.8% +38.7% +11.4% 🚨 regression
59 datafusion:vortex-compact +36.2% +0.6% +35.4% +10.0% 🚨 regression
59 datafusion:vortex-file-compressed +7.5% +0.6% +6.8% +10.9% ➖ noise
59 duckdb:duckdb -2.2% +0.6% -2.8% +10.0% ➖ noise
59 duckdb:vortex-compact -20.6% +0.6% -21.1% +10.0% ✅ faster
59 duckdb:vortex-file-compressed -39.0% +0.6% -39.3% +10.0% ✅ faster
60 datafusion:vortex-compact +31.7% -0.1% +31.9% +10.0% 🚨 regression
60 datafusion:vortex-file-compressed +13.1% -0.1% +13.3% +10.0% 🚨 regression
60 duckdb:duckdb -1.0% -0.1% -0.8% +10.8% ➖ noise
60 duckdb:vortex-compact +18.4% -0.1% +18.6% +10.0% 🚨 regression
60 duckdb:vortex-file-compressed +50.8% -0.1% +51.0% +10.0% 🚨 regression
61 datafusion:vortex-compact +79.8% -2.1% +83.7% +10.0% 🚨 regression
61 datafusion:vortex-file-compressed +20.9% -2.1% +23.6% +10.0% 🚨 regression
61 duckdb:duckdb +0.1% -2.1% +2.3% +10.0% ➖ noise
61 duckdb:vortex-compact +93.3% -2.1% +97.5% +10.0% 🚨 regression
61 duckdb:vortex-file-compressed +32.8% -2.1% +35.7% +13.6% 🚨 regression
62 datafusion:vortex-compact +5.2% +8.3% -2.9% +10.0% ➖ noise
62 datafusion:vortex-file-compressed +0.1% +8.3% -7.5% +11.2% ➖ noise
62 duckdb:duckdb +0.8% +8.3% -6.9% +12.0% ➖ noise
62 duckdb:vortex-compact -25.4% +8.3% -31.2% +25.3% ✅ faster
62 duckdb:vortex-file-compressed -12.9% +8.3% -19.6% +21.7% ✅ faster
63 datafusion:vortex-compact +77.5% -1.5% +80.2% +10.0% 🚨 regression
63 datafusion:vortex-file-compressed +13.7% -1.5% +15.4% +10.0% 🚨 regression
63 duckdb:duckdb +0.8% -1.5% +2.3% +10.0% ➖ noise
63 duckdb:vortex-compact +86.1% -1.5% +88.9% +10.0% 🚨 regression
63 duckdb:vortex-file-compressed +19.4% -1.5% +21.2% +12.7% 🚨 regression
64 datafusion:vortex-compact +11.9% +0.8% +11.0% +10.0% 🚨 regression
64 datafusion:vortex-file-compressed +8.3% +0.8% +7.4% +10.0% ➖ noise
64 duckdb:duckdb -1.6% +0.8% -2.4% +10.0% ➖ noise
64 duckdb:vortex-compact +47.8% +0.8% +46.6% +10.0% 🚨 regression
64 duckdb:vortex-file-compressed +45.8% +0.8% +44.6% +10.0% 🚨 regression
65 datafusion:vortex-compact +77.4% -0.2% +77.8% +10.0% 🚨 regression
65 datafusion:vortex-file-compressed +16.4% -0.2% +16.7% +10.0% 🚨 regression
65 duckdb:duckdb -3.2% -0.2% -3.0% +15.1% ➖ noise
65 duckdb:vortex-compact +70.4% -0.2% +70.9% +10.0% 🚨 regression
65 duckdb:vortex-file-compressed +18.8% -0.2% +19.1% +10.0% 🚨 regression
66 datafusion:vortex-compact +10.8% +7.0% +3.5% +11.1% ➖ noise
66 datafusion:vortex-file-compressed -0.5% +7.0% -7.0% +10.3% ➖ noise
66 duckdb:duckdb +0.4% +7.0% -6.2% +13.7% ➖ noise
66 duckdb:vortex-compact -7.3% +7.0% -13.3% +18.4% ➖ noise
66 duckdb:vortex-file-compressed +31.8% +7.0% +23.2% +15.4% 🚨 regression
67 datafusion:vortex-compact +22.4% -2.4% +25.4% +10.0% 🚨 regression
67 datafusion:vortex-file-compressed +0.4% -2.4% +2.8% +10.0% ➖ noise
67 duckdb:duckdb -2.3% -2.4% +0.0% +10.0% ➖ noise
67 duckdb:vortex-compact +21.0% -2.4% +23.9% +10.0% 🚨 regression
67 duckdb:vortex-file-compressed +12.2% -2.4% +14.9% +10.0% 🚨 regression
68 datafusion:vortex-compact +38.9% +0.9% +37.7% +10.0% 🚨 regression
68 datafusion:vortex-file-compressed +17.1% +0.9% +16.1% +10.0% 🚨 regression
68 duckdb:duckdb +0.7% +0.9% -0.2% +10.0% ➖ noise
68 duckdb:vortex-compact +47.6% +0.9% +46.3% +10.0% 🚨 regression
68 duckdb:vortex-file-compressed +15.7% +0.9% +14.7% +10.0% 🚨 regression
69 datafusion:vortex-compact +26.1% +1.0% +24.8% +10.0% 🚨 regression
69 datafusion:vortex-file-compressed +8.6% +1.0% +7.5% +10.0% ➖ noise
69 duckdb:duckdb -3.4% +1.0% -4.4% +11.8% ➖ noise
69 duckdb:vortex-compact +42.5% +1.0% +41.1% +10.0% 🚨 regression
69 duckdb:vortex-file-compressed +25.5% +1.0% +24.3% +13.7% 🚨 regression
70 datafusion:vortex-compact +18.5% +2.1% +16.0% +10.3% 🚨 regression
70 datafusion:vortex-file-compressed +7.4% +2.1% +5.2% +10.0% ➖ noise
70 duckdb:duckdb -4.8% +2.1% -6.8% +14.0% ➖ noise
70 duckdb:vortex-compact +5.8% +2.1% +3.5% +10.0% ➖ noise
70 duckdb:vortex-file-compressed -11.0% +2.1% -12.8% +10.6% ✅ faster
71 datafusion:vortex-compact +41.8% +0.2% +41.6% +10.0% 🚨 regression
71 datafusion:vortex-file-compressed +25.4% +0.2% +25.2% +10.0% 🚨 regression
71 duckdb:duckdb -12.9% +0.2% -13.1% +16.8% ➖ noise
71 duckdb:vortex-compact +62.7% +0.2% +62.4% +10.0% 🚨 regression
71 duckdb:vortex-file-compressed +26.5% +0.2% +26.3% +11.8% 🚨 regression
72 datafusion:vortex-compact +1.3% +0.3% +1.0% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +2.8% +0.3% +2.5% +10.0% ➖ noise
72 duckdb:duckdb +1.0% +0.3% +0.7% +15.3% ➖ noise
72 duckdb:vortex-compact -16.2% +0.3% -16.5% +10.0% ✅ faster
72 duckdb:vortex-file-compressed -15.1% +0.3% -15.4% +10.0% ✅ faster
73 datafusion:vortex-compact +42.1% +2.7% +38.3% +14.1% 🚨 regression
73 datafusion:vortex-file-compressed +5.0% +2.7% +2.3% +23.6% ➖ noise
73 duckdb:duckdb -0.6% +2.7% -3.3% +11.0% ➖ noise
73 duckdb:vortex-compact +99.9% +2.7% +94.6% +10.0% 🚨 regression
73 duckdb:vortex-file-compressed +32.3% +2.7% +28.8% +17.4% 🚨 regression
74 datafusion:vortex-compact +27.1% +2.7% +23.7% +10.0% 🚨 regression
74 datafusion:vortex-file-compressed +8.3% +2.7% +5.4% +10.0% ➖ noise
74 duckdb:duckdb -3.0% +2.7% -5.6% +10.0% ➖ noise
74 duckdb:vortex-compact +51.6% +2.7% +47.6% +10.0% 🚨 regression
74 duckdb:vortex-file-compressed +13.3% +2.7% +10.3% +10.5% ➖ noise
75 datafusion:vortex-compact +25.6% +0.5% +25.0% +10.0% 🚨 regression
75 datafusion:vortex-file-compressed +15.7% +0.5% +15.2% +10.0% 🚨 regression
75 duckdb:duckdb +3.7% +0.5% +3.2% +10.0% ➖ noise
75 duckdb:vortex-compact +20.8% +0.5% +20.2% +10.1% 🚨 regression
75 duckdb:vortex-file-compressed +7.8% +0.5% +7.3% +10.0% ➖ noise
76 datafusion:vortex-compact +64.7% -0.3% +65.1% +10.0% 🚨 regression
76 datafusion:vortex-file-compressed +30.7% -0.3% +31.1% +10.0% 🚨 regression
76 duckdb:duckdb -2.3% -0.3% -2.0% +22.1% ➖ noise
76 duckdb:vortex-compact +75.6% -0.3% +76.1% +10.0% 🚨 regression
76 duckdb:vortex-file-compressed +96.1% -0.3% +96.7% +27.5% 🚨 regression
77 datafusion:vortex-compact +19.1% -0.8% +20.0% +10.0% 🚨 regression
77 datafusion:vortex-file-compressed +6.0% -0.8% +6.8% +10.0% ➖ noise
77 duckdb:duckdb -2.4% -0.8% -1.7% +12.8% ➖ noise
77 duckdb:vortex-compact +44.8% -0.8% +46.0% +10.0% 🚨 regression
77 duckdb:vortex-file-compressed +70.9% -0.8% +72.2% +11.5% 🚨 regression
78 datafusion:vortex-compact +19.7% +2.5% +16.8% +10.0% 🚨 regression
78 datafusion:vortex-file-compressed +12.2% +2.5% +9.5% +10.0% ➖ noise
78 duckdb:duckdb -3.4% +2.5% -5.7% +10.0% ➖ noise
78 duckdb:vortex-compact +19.9% +2.5% +17.1% +10.0% 🚨 regression
78 duckdb:vortex-file-compressed +5.1% +2.5% +2.6% +10.0% ➖ noise
79 datafusion:vortex-compact +44.8% -1.0% +46.3% +10.0% 🚨 regression
79 datafusion:vortex-file-compressed +24.0% -1.0% +25.3% +10.0% 🚨 regression
79 duckdb:duckdb +3.9% -1.0% +5.0% +28.1% ➖ noise
79 duckdb:vortex-compact +129.1% -1.0% +131.5% +10.0% 🚨 regression
79 duckdb:vortex-file-compressed +31.0% -1.0% +32.4% +10.6% 🚨 regression
80 datafusion:vortex-compact +28.4% +0.9% +27.2% +10.0% 🚨 regression
80 datafusion:vortex-file-compressed +8.1% +0.9% +7.1% +10.0% ➖ noise
80 duckdb:duckdb +3.0% +0.9% +2.1% +10.7% ➖ noise
80 duckdb:vortex-compact +17.7% +0.9% +16.6% +10.0% 🚨 regression
80 duckdb:vortex-file-compressed +30.6% +0.9% +29.4% +12.3% 🚨 regression
81 datafusion:vortex-compact -17.5% -1.4% -16.3% +10.0% ✅ faster
81 datafusion:vortex-file-compressed -9.0% -1.4% -7.7% +10.1% ➖ noise
81 duckdb:duckdb +7.1% -1.4% +8.7% +11.2% ➖ noise
81 duckdb:vortex-compact -27.8% -1.4% -26.8% +14.2% ✅ faster
81 duckdb:vortex-file-compressed -17.3% -1.4% -16.1% +11.7% ✅ faster
82 datafusion:vortex-compact +37.1% +1.7% +34.8% +10.0% 🚨 regression
82 datafusion:vortex-file-compressed +63.3% +1.7% +60.5% +10.0% 🚨 regression
82 duckdb:duckdb +1.0% +1.7% -0.8% +14.3% ➖ noise
82 duckdb:vortex-compact +38.7% +1.7% +36.4% +10.0% 🚨 regression
82 duckdb:vortex-file-compressed +82.6% +1.7% +79.5% +10.0% 🚨 regression
83 datafusion:vortex-compact -1.7% +0.3% -2.0% +10.0% ➖ noise
83 datafusion:vortex-file-compressed +4.2% +0.3% +3.9% +10.0% ➖ noise
83 duckdb:duckdb -7.1% +0.3% -7.4% +12.5% ➖ noise
83 duckdb:vortex-compact -22.6% +0.3% -22.8% +10.0% ✅ faster
83 duckdb:vortex-file-compressed +18.2% +0.3% +17.8% +18.0% ➖ noise
84 datafusion:vortex-compact -7.6% +0.4% -7.9% +13.2% ➖ noise
84 datafusion:vortex-file-compressed +3.4% +0.4% +3.0% +10.2% ➖ noise
84 duckdb:duckdb +7.5% +0.4% +7.1% +10.0% ➖ noise
84 duckdb:vortex-compact -3.3% +0.4% -3.6% +12.9% ➖ noise
84 duckdb:vortex-file-compressed +9.0% +0.4% +8.5% +29.1% ➖ noise
85 datafusion:vortex-compact +33.3% +0.5% +32.7% +10.0% 🚨 regression
85 datafusion:vortex-file-compressed +23.2% +0.5% +22.6% +10.0% 🚨 regression
85 duckdb:duckdb +3.2% +0.5% +2.6% +11.9% ➖ noise
85 duckdb:vortex-compact -12.1% +0.5% -12.5% +10.0% ✅ faster
85 duckdb:vortex-file-compressed -13.6% +0.5% -14.0% +10.0% ✅ faster
86 datafusion:vortex-compact +7.8% +2.0% +5.7% +10.0% ➖ noise
86 datafusion:vortex-file-compressed +5.0% +2.0% +2.9% +10.4% ➖ noise
86 duckdb:duckdb +0.0% +2.0% -1.9% +18.8% ➖ noise
86 duckdb:vortex-compact -25.3% +2.0% -26.8% +21.2% ✅ faster
86 duckdb:vortex-file-compressed -7.9% +2.0% -9.8% +21.9% ➖ noise
87 datafusion:vortex-compact +12.1% -1.6% +13.9% +10.0% 🚨 regression
87 datafusion:vortex-file-compressed +7.3% -1.6% +9.1% +10.0% ➖ noise
87 duckdb:duckdb +1.3% -1.6% +3.0% +14.2% ➖ noise
87 duckdb:vortex-compact +25.7% -1.6% +27.8% +16.8% 🚨 regression
87 duckdb:vortex-file-compressed -8.4% -1.6% -6.8% +12.8% ➖ noise
88 datafusion:vortex-compact +74.9% -1.0% +76.7% +10.0% 🚨 regression
88 datafusion:vortex-file-compressed +29.0% -1.0% +30.3% +10.0% 🚨 regression
88 duckdb:duckdb -0.5% -1.0% +0.6% +10.0% ➖ noise
88 duckdb:vortex-compact +61.7% -1.0% +63.4% +10.0% 🚨 regression
88 duckdb:vortex-file-compressed +16.0% -1.0% +17.2% +10.0% 🚨 regression
89 datafusion:vortex-compact +59.2% -1.5% +61.6% +10.0% 🚨 regression
89 datafusion:vortex-file-compressed +14.2% -1.5% +15.9% +10.0% 🚨 regression
89 duckdb:duckdb -5.3% -1.5% -3.9% +10.9% ➖ noise
89 duckdb:vortex-compact +93.6% -1.5% +96.5% +10.0% 🚨 regression
89 duckdb:vortex-file-compressed +24.9% -1.5% +26.8% +10.0% 🚨 regression
90 datafusion:vortex-compact -4.4% -3.1% -1.4% +10.0% ➖ noise
90 datafusion:vortex-file-compressed +12.2% -3.1% +15.7% +10.3% 🚨 regression
90 duckdb:duckdb -0.9% -3.1% +2.2% +11.8% ➖ noise
90 duckdb:vortex-compact -6.1% -3.1% -3.2% +11.1% ➖ noise
90 duckdb:vortex-file-compressed -6.5% -3.1% -3.6% +10.7% ➖ noise
91 datafusion:vortex-compact +28.7% -2.1% +31.4% +10.0% 🚨 regression
91 datafusion:vortex-file-compressed +10.1% -2.1% +12.5% +10.0% 🚨 regression
91 duckdb:duckdb -2.7% -2.1% -0.7% +12.7% ➖ noise
91 duckdb:vortex-compact +15.7% -2.1% +18.1% +10.0% 🚨 regression
91 duckdb:vortex-file-compressed -8.6% -2.1% -6.6% +10.0% ➖ noise
92 datafusion:vortex-compact +20.5% +1.0% +19.3% +10.0% 🚨 regression
92 datafusion:vortex-file-compressed +16.8% +1.0% +15.7% +10.0% 🚨 regression
92 duckdb:duckdb -1.6% +1.0% -2.5% +19.0% ➖ noise
92 duckdb:vortex-compact -3.2% +1.0% -4.1% +11.6% ➖ noise
92 duckdb:vortex-file-compressed +1.2% +1.0% +0.2% +10.0% ➖ noise
93 datafusion:vortex-compact +15.9% +3.7% +11.8% +10.0% 🚨 regression
93 datafusion:vortex-file-compressed +24.4% +3.7% +20.0% +10.0% 🚨 regression
93 duckdb:duckdb -2.3% +3.7% -5.8% +20.7% ➖ noise
93 duckdb:vortex-compact +2.2% +3.7% -1.5% +10.0% ➖ noise
93 duckdb:vortex-file-compressed +11.7% +3.7% +7.7% +10.0% ➖ noise
94 datafusion:vortex-compact +2.9% -0.2% +3.1% +10.0% ➖ noise
94 datafusion:vortex-file-compressed +15.2% -0.2% +15.4% +11.6% 🚨 regression
94 duckdb:duckdb +7.1% -0.2% +7.3% +11.7% ➖ noise
94 duckdb:vortex-compact -1.9% -0.2% -1.8% +10.0% ➖ noise
94 duckdb:vortex-file-compressed +15.2% -0.2% +15.4% +10.0% 🚨 regression
95 datafusion:vortex-compact +4.5% -5.0% +10.0% +10.0% 🚨 regression
95 datafusion:vortex-file-compressed +9.0% -5.0% +14.8% +10.0% 🚨 regression
95 duckdb:duckdb -5.7% -5.0% -0.7% +22.2% ➖ noise
95 duckdb:vortex-compact -39.1% -5.0% -35.8% +11.6% ✅ faster
95 duckdb:vortex-file-compressed -41.3% -5.0% -38.1% +17.2% ✅ faster
96 datafusion:vortex-compact +45.2% +6.6% +36.3% +10.0% 🚨 regression
96 datafusion:vortex-file-compressed +28.0% +6.6% +20.1% +10.0% 🚨 regression
96 duckdb:duckdb -3.2% +6.6% -9.1% +20.0% ➖ noise
96 duckdb:vortex-compact +100.3% +6.6% +88.0% +10.0% 🚨 regression
96 duckdb:vortex-file-compressed +28.6% +6.6% +20.7% +13.7% 🚨 regression
97 datafusion:vortex-compact +33.6% +2.8% +30.0% +10.0% 🚨 regression
97 datafusion:vortex-file-compressed +23.9% +2.8% +20.5% +11.7% 🚨 regression
97 duckdb:duckdb +3.4% +2.8% +0.6% +11.8% ➖ noise
97 duckdb:vortex-compact +28.4% +2.8% +24.9% +12.1% 🚨 regression
97 duckdb:vortex-file-compressed +3.1% +2.8% +0.3% +13.1% ➖ noise
98 datafusion:vortex-compact +33.1% +1.0% +31.7% +10.0% 🚨 regression
98 datafusion:vortex-file-compressed +13.2% +1.0% +12.0% +10.0% 🚨 regression
98 duckdb:duckdb +3.7% +1.0% +2.7% +12.9% ➖ noise
98 duckdb:vortex-compact +46.7% +1.0% +45.2% +10.0% 🚨 regression
98 duckdb:vortex-file-compressed +20.6% +1.0% +19.4% +11.2% 🚨 regression
99 datafusion:vortex-compact +2.8% -4.1% +7.1% +16.3% ➖ noise
99 datafusion:vortex-file-compressed +6.4% -4.1% +10.9% +15.9% ➖ noise
99 duckdb:duckdb -2.6% -4.1% +1.6% +16.5% ➖ noise
99 duckdb:vortex-compact -39.2% -4.1% -36.6% +17.2% ✅ faster
99 duckdb:vortex-file-compressed -38.9% -4.1% -36.3% +12.9% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 15, 2026

File Sizes: TPC-DS SF=1 on NVME

File Size Changes (48 files changed, +2.3% overall, 25↑ 23↓)
File Scale Format Base HEAD Change %
customer_demographics.vortex 1.0 vortex-file-compressed 1.47 MB 1.92 MB +465.78 KB +31.0%
customer_demographics.vortex 1.0 vortex-compact 624.14 KB 799.41 KB +175.27 KB +28.1%
time_dim.vortex 1.0 vortex-compact 85.51 KB 102.11 KB +16.60 KB +19.4%
date_dim.vortex 1.0 vortex-compact 131.05 KB 154.85 KB +23.80 KB +18.2%
inventory.vortex 1.0 vortex-compact 15.95 MB 17.10 MB +1.15 MB +7.2%
date_dim.vortex 1.0 vortex-file-compressed 1.01 MB 1.06 MB +51.32 KB +5.0%
store_sales.vortex 1.0 vortex-compact 77.67 MB 79.72 MB +2.05 MB +2.6%
web_sales.vortex 1.0 vortex-file-compressed 33.58 MB 34.45 MB +895.90 KB +2.6%
web_sales.vortex 1.0 vortex-compact 29.26 MB 29.93 MB +684.80 KB +2.3%
catalog_sales.vortex 1.0 vortex-compact 59.15 MB 60.45 MB +1.30 MB +2.2%
catalog_sales.vortex 1.0 vortex-file-compressed 69.41 MB 70.75 MB +1.34 MB +1.9%
inventory.vortex 1.0 vortex-file-compressed 36.56 MB 37.27 MB +722.48 KB +1.9%
item.vortex 1.0 vortex-compact 975.23 KB 993.08 KB +17.85 KB +1.8%
store_sales.vortex 1.0 vortex-file-compressed 96.78 MB 98.53 MB +1.75 MB +1.8%
store_returns.vortex 1.0 vortex-compact 9.28 MB 9.44 MB +160.87 KB +1.7%
web_returns.vortex 1.0 vortex-compact 2.97 MB 3.02 MB +49.71 KB +1.6%
item.vortex 1.0 vortex-file-compressed 1.72 MB 1.75 MB +26.62 KB +1.5%
catalog_returns.vortex 1.0 vortex-compact 5.99 MB 6.06 MB +74.73 KB +1.2%
customer.vortex 1.0 vortex-compact 3.27 MB 3.31 MB +38.68 KB +1.2%
customer_address.vortex 1.0 vortex-compact 546.50 KB 552.20 KB +5.70 KB +1.0%
web_returns.vortex 1.0 vortex-file-compressed 3.46 MB 3.48 MB +17.85 KB +0.5%
store_returns.vortex 1.0 vortex-file-compressed 11.10 MB 11.13 MB +28.88 KB +0.3%
catalog_page.vortex 1.0 vortex-file-compressed 601.77 KB 603.22 KB +1.45 KB +0.2%
customer.vortex 1.0 vortex-file-compressed 4.49 MB 4.50 MB +7.63 KB +0.2%
catalog_page.vortex 1.0 vortex-compact 354.25 KB 354.43 KB +184 B +0.1%
promotion.vortex 1.0 vortex-file-compressed 42.74 KB 42.53 KB 216 B -0.5%
web_site.vortex 1.0 vortex-file-compressed 35.71 KB 35.50 KB 216 B -0.6%
promotion.vortex 1.0 vortex-compact 35.10 KB 34.89 KB 216 B -0.6%
call_center.vortex 1.0 vortex-file-compressed 33.96 KB 33.75 KB 216 B -0.6%
call_center.vortex 1.0 vortex-compact 31.11 KB 30.90 KB 216 B -0.7%
store.vortex 1.0 vortex-file-compressed 31.08 KB 30.87 KB 216 B -0.7%
web_site.vortex 1.0 vortex-compact 29.25 KB 29.04 KB 216 B -0.7%
catalog_returns.vortex 1.0 vortex-file-compressed 7.28 MB 7.23 MB 54.59 KB -0.7%
store.vortex 1.0 vortex-compact 28.55 KB 28.34 KB 216 B -0.7%
customer_address.vortex 1.0 vortex-file-compressed 992.28 KB 984.30 KB 7.98 KB -0.8%
web_page.vortex 1.0 vortex-file-compressed 20.84 KB 20.63 KB 216 B -1.0%
web_page.vortex 1.0 vortex-compact 17.78 KB 17.57 KB 216 B -1.2%
warehouse.vortex 1.0 vortex-file-compressed 14.98 KB 14.76 KB 224 B -1.5%
household_demographics.vortex 1.0 vortex-file-compressed 13.62 KB 13.41 KB 216 B -1.5%
warehouse.vortex 1.0 vortex-compact 14.11 KB 13.89 KB 224 B -1.6%
ship_mode.vortex 1.0 vortex-file-compressed 9.03 KB 8.82 KB 216 B -2.3%
ship_mode.vortex 1.0 vortex-compact 7.66 KB 7.45 KB 216 B -2.8%
household_demographics.vortex 1.0 vortex-compact 7.40 KB 7.19 KB 216 B -2.9%
time_dim.vortex 1.0 vortex-file-compressed 673.50 KB 650.43 KB 23.07 KB -3.4%
reason.vortex 1.0 vortex-file-compressed 5.66 KB 5.45 KB 224 B -3.9%
reason.vortex 1.0 vortex-compact 4.63 KB 4.41 KB 224 B -4.7%
income_band.vortex 1.0 vortex-file-compressed 4.54 KB 4.32 KB 224 B -4.8%
income_band.vortex 1.0 vortex-compact 4.37 KB 4.15 KB 224 B -5.0%

Totals:

  • vortex-compact: 206.63 MB → 212.35 MB (+2.8%)
  • vortex-file-compressed: 269.55 MB → 274.73 MB (+1.9%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 15, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +16.0%
Vortex (geomean): 1.098x ➖
Parquet (geomean): 0.946x ➖
Shifts: Parquet (control) -5.4% · Median polish +1.7%

datafusion / vortex-file-compressed (1.407x ❌, 0↑ 3↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 78737988 34041237 2.31
fineweb_q01/datafusion:vortex-file-compressed 🚨 1461737700 526881087 2.77
fineweb_q02/datafusion:vortex-file-compressed 🚨 1552060449 577886404 2.69
fineweb_q03/datafusion:vortex-file-compressed 1557376565 1453713975 1.07
fineweb_q04/datafusion:vortex-file-compressed 1376456793 1379539465 1.00
fineweb_q05/datafusion:vortex-file-compressed 1494481562 1387402310 1.08
fineweb_q06/datafusion:vortex-file-compressed 2022825562 1576902106 1.28
fineweb_q07/datafusion:vortex-file-compressed 1425164210 1493111564 0.95
fineweb_q08/datafusion:vortex-file-compressed 547582288 616366138 0.89
datafusion / vortex-compact (0.970x ➖, 1↑ 1↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 59797356 33906039 1.76
fineweb_q01/datafusion:vortex-compact 590462905 681102988 0.87
fineweb_q02/datafusion:vortex-compact 🚀 568056665 859167289 0.66
fineweb_q03/datafusion:vortex-compact 1743496760 1861233025 0.94
fineweb_q04/datafusion:vortex-compact 2126649400 2199807307 0.97
fineweb_q05/datafusion:vortex-compact 1680878841 1679899824 1.00
fineweb_q06/datafusion:vortex-compact 1427695223 1482752894 0.96
fineweb_q07/datafusion:vortex-compact 1227227186 1337241248 0.92
fineweb_q08/datafusion:vortex-compact 390243493 414998716 0.94
datafusion / parquet (0.909x ➖, 0↑ 0↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1448450866 1898414606 0.76
fineweb_q01/datafusion:parquet 1778647230 1910404341 0.93
fineweb_q02/datafusion:parquet 1728637365 1983242943 0.87
fineweb_q03/datafusion:parquet 2137694825 1948425993 1.10
fineweb_q04/datafusion:parquet 1830376545 1922855963 0.95
fineweb_q05/datafusion:parquet 1800577742 2079624093 0.87
fineweb_q06/datafusion:parquet 1814007596 1839728470 0.99
fineweb_q07/datafusion:parquet 1739216827 1821628509 0.95
fineweb_q08/datafusion:parquet 1791600767 2225371322 0.81
duckdb / vortex-file-compressed (1.033x ➖, 0↑ 0↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 81430397 84890947 0.96
fineweb_q01/duckdb:vortex-file-compressed 643675790 594142662 1.08
fineweb_q02/duckdb:vortex-file-compressed 553426519 496701139 1.11
fineweb_q03/duckdb:vortex-file-compressed 1555143987 1535497642 1.01
fineweb_q04/duckdb:vortex-file-compressed 1588057740 1471423285 1.08
fineweb_q05/duckdb:vortex-file-compressed 1610435869 1540986860 1.05
fineweb_q06/duckdb:vortex-file-compressed 1668470953 1624668742 1.03
fineweb_q07/duckdb:vortex-file-compressed 1455981078 1484838950 0.98
fineweb_q08/duckdb:vortex-file-compressed 654532419 653642975 1.00
duckdb / vortex-compact (1.031x ➖, 0↑ 0↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 94460185 79891771 1.18
fineweb_q01/duckdb:vortex-compact 682991616 645598002 1.06
fineweb_q02/duckdb:vortex-compact 528005861 599330531 0.88
fineweb_q03/duckdb:vortex-compact 1824377745 1549937067 1.18
fineweb_q04/duckdb:vortex-compact 1768527693 1679717532 1.05
fineweb_q05/duckdb:vortex-compact 1583886187 1541429317 1.03
fineweb_q06/duckdb:vortex-compact 1585893435 1431700063 1.11
fineweb_q07/duckdb:vortex-compact 1399405569 1444294070 0.97
fineweb_q08/duckdb:vortex-compact 493532948 567076245 0.87
duckdb / parquet (0.985x ➖, 0↑ 0↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1084519670 1183614884 0.92
fineweb_q01/duckdb:parquet 1649318120 1698488521 0.97
fineweb_q02/duckdb:parquet 1694915663 1760195738 0.96
fineweb_q03/duckdb:parquet 4421781174 4494918718 0.98
fineweb_q04/duckdb:parquet 1854607997 1948720368 0.95
fineweb_q05/duckdb:parquet 2985896827 2838160141 1.05
fineweb_q06/duckdb:parquet 3589090751 3541954248 1.01
fineweb_q07/duckdb:parquet 4199105196 3972730733 1.06
fineweb_q08/duckdb:parquet 1114877265 1156987352 0.96
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +76.4% -16.4% +110.9% +167.7% ➖ noise
0 datafusion:vortex-file-compressed +131.3% -16.4% +176.6% +275.3% ➖ noise
0 duckdb:vortex-compact +18.2% -16.4% +41.4% +83.6% ➖ noise
0 duckdb:vortex-file-compressed -4.1% -16.4% +14.7% +37.3% ➖ noise
1 datafusion:vortex-compact -13.3% -4.9% -8.8% +94.0% ➖ noise
1 datafusion:vortex-file-compressed +177.4% -4.9% +191.8% +72.1% 🚨 regression
1 duckdb:vortex-compact +5.8% -4.9% +11.3% +30.0% ➖ noise
1 duckdb:vortex-file-compressed +8.3% -4.9% +13.9% +43.3% ➖ noise
2 datafusion:vortex-compact -33.9% -8.4% -27.8% +52.7% ➖ noise
2 datafusion:vortex-file-compressed +168.6% -8.4% +193.2% +87.2% 🚨 regression
2 duckdb:vortex-compact -11.9% -8.4% -3.8% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +11.4% -8.4% +21.6% +30.0% ➖ noise
3 datafusion:vortex-compact -6.3% +3.9% -9.8% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +7.1% +3.9% +3.1% +43.6% ➖ noise
3 duckdb:vortex-compact +17.7% +3.9% +13.3% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +1.3% +3.9% -2.5% +30.0% ➖ noise
4 datafusion:vortex-compact -3.3% -4.8% +1.6% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -0.2% -4.8% +4.8% +30.0% ➖ noise
4 duckdb:vortex-compact +5.3% -4.8% +10.6% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +7.9% -4.8% +13.4% +30.0% ➖ noise
5 datafusion:vortex-compact +0.1% -4.6% +4.8% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +7.7% -4.6% +12.9% +30.0% ➖ noise
5 duckdb:vortex-compact +2.8% -4.6% +7.7% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +4.5% -4.6% +9.5% +30.0% ➖ noise
6 datafusion:vortex-compact -3.7% -0.0% -3.7% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +28.3% -0.0% +28.3% +30.0% ➖ noise
6 duckdb:vortex-compact +10.8% -0.0% +10.8% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +2.7% -0.0% +2.7% +30.0% ➖ noise
7 datafusion:vortex-compact -8.2% +0.5% -8.6% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -4.6% +0.5% -5.0% +30.0% ➖ noise
7 duckdb:vortex-compact -3.1% +0.5% -3.5% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -1.9% +0.5% -2.4% +30.0% ➖ noise
8 datafusion:vortex-compact -6.0% -11.9% +6.8% +31.1% ➖ noise
8 datafusion:vortex-file-compressed -11.2% -11.9% +0.9% +30.0% ➖ noise
8 duckdb:vortex-compact -13.0% -11.9% -1.2% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +0.1% -11.9% +13.7% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 15, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.2%
Vortex (geomean): 0.971x ➖
Parquet (geomean): 0.993x ➖
Shifts: Parquet (control) -0.7% · Median polish -0.4%

duckdb / vortex-file-compressed (0.980x ➖, 0↑ 0↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 10795689 10768322 1.00
statpopgen_q01/duckdb:vortex-file-compressed 49856915 53828048 0.93
statpopgen_q02/duckdb:vortex-file-compressed 1300072433 1295362320 1.00
statpopgen_q03/duckdb:vortex-file-compressed 3072927594 3063705086 1.00
statpopgen_q04/duckdb:vortex-file-compressed 3100528182 3071527569 1.01
statpopgen_q05/duckdb:vortex-file-compressed 1392868435 1409509607 0.99
statpopgen_q06/duckdb:vortex-file-compressed 2065852225 2069766738 1.00
statpopgen_q07/duckdb:vortex-file-compressed 324321716 344028674 0.94
statpopgen_q08/duckdb:vortex-file-compressed 344202233 366190306 0.94
statpopgen_q09/duckdb:vortex-file-compressed 2834345910 2916783354 0.97
statpopgen_q10/duckdb:vortex-file-compressed 4608805045 4619632102 1.00
duckdb / vortex-compact (0.963x ➖, 2↑ 0↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10617655 10584805 1.00
statpopgen_q01/duckdb:vortex-compact 164517757 165145814 1.00
statpopgen_q02/duckdb:vortex-compact 1819628500 1787904666 1.02
statpopgen_q03/duckdb:vortex-compact 3495617692 3467754512 1.01
statpopgen_q04/duckdb:vortex-compact 3534939879 3544262896 1.00
statpopgen_q05/duckdb:vortex-compact 1801892686 1823371726 0.99
statpopgen_q06/duckdb:vortex-compact 2658986184 2677911730 0.99
statpopgen_q07/duckdb:vortex-compact 🚀 746436785 923287206 0.81
statpopgen_q08/duckdb:vortex-compact 🚀 774802499 959774791 0.81
statpopgen_q09/duckdb:vortex-compact 3338915407 3315482118 1.01
statpopgen_q10/duckdb:vortex-compact 5385225778 5387264350 1.00
duckdb / parquet (0.993x ➖, 0↑ 0↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 305096398 313468831 0.97
statpopgen_q01/duckdb:parquet 392549215 389905410 1.01
statpopgen_q02/duckdb:parquet 989057512 995425718 0.99
statpopgen_q03/duckdb:parquet 1482685055 1477066584 1.00
statpopgen_q04/duckdb:parquet 1482077885 1519073239 0.98
statpopgen_q05/duckdb:parquet 994557877 989578103 1.01
statpopgen_q06/duckdb:parquet 1471527393 1485713534 0.99
statpopgen_q07/duckdb:parquet 1856898918 1845670049 1.01
statpopgen_q08/duckdb:parquet 1866734235 1866032697 1.00
statpopgen_q09/duckdb:parquet 1369401665 1385189094 0.99
statpopgen_q10/duckdb:parquet 2660347314 2704476614 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +0.3% -2.7% +3.1% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +0.3% -2.7% +3.0% +11.3% ➖ noise
1 duckdb:vortex-compact -0.4% +0.7% -1.1% +27.9% ➖ noise
1 duckdb:vortex-file-compressed -7.4% +0.7% -8.0% +272.7% ➖ noise
2 duckdb:vortex-compact +1.8% -0.6% +2.4% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +0.4% -0.6% +1.0% +10.0% ➖ noise
3 duckdb:vortex-compact +0.8% +0.4% +0.4% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.3% +0.4% -0.1% +10.0% ➖ noise
4 duckdb:vortex-compact -0.3% -2.4% +2.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.9% -2.4% +3.5% +10.0% ➖ noise
5 duckdb:vortex-compact -1.2% +0.5% -1.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.2% +0.5% -1.7% +10.0% ➖ noise
6 duckdb:vortex-compact -0.7% -1.0% +0.3% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.2% -1.0% +0.8% +10.0% ➖ noise
7 duckdb:vortex-compact -19.2% +0.6% -19.6% +10.0% ✅ faster
7 duckdb:vortex-file-compressed -5.7% +0.6% -6.3% +10.0% ➖ noise
8 duckdb:vortex-compact -19.3% +0.0% -19.3% +10.0% ✅ faster
8 duckdb:vortex-file-compressed -6.0% +0.0% -6.0% +10.0% ➖ noise
9 duckdb:vortex-compact +0.7% -1.1% +1.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -2.8% -1.1% -1.7% +10.0% ➖ noise
10 duckdb:vortex-compact -0.0% -1.6% +1.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.2% -1.6% +1.4% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 15, 2026

File Sizes: Statistical and Population Genetics

File Size Changes (2 files changed, -2.3% overall, 1↑ 1↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 955.21 MB 956.88 MB +1.66 MB +0.2%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.78 GB 1.71 GB 65.26 MB -3.6%

Totals:

  • vortex-compact: 955.47 MB → 957.14 MB (+0.2%)
  • vortex-file-compressed: 1.78 GB → 1.71 GB (-3.6%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 15, 2026

Benchmarks: Random Access

Vortex (geomean): 2.188x ❌
Parquet (geomean): 1.000x ➖

unknown / unknown (1.301x ❌, 1↑ 12↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 2898595 2487417 1.17
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1275371 1309605 0.97
random-access/feature-vectors/correlated/parquet-tokio-local-disk 11551717214 11837383569 0.98
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 11184369026 11329373860 0.99
random-access/feature-vectors/correlated/vortex-tokio-local-disk 🚨 110266286 9711254 11.35
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚨 109425940 8122737 13.47
random-access/feature-vectors/uniform/lance-tokio-local-disk 1534035 1556817 0.99
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2438410 2462041 0.99
random-access/feature-vectors/uniform/parquet-tokio-local-disk 11187873357 11259775186 0.99
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 11180235519 11284605770 0.99
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚨 119601772 15102717 7.92
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 🚨 120885964 15259729 7.92
random-access/lance-tokio-local-disk 755650 754765 1.00
random-access/lance-tokio-local-disk-footer 1361369 1361706 1.00
random-access/nested-lists/correlated/lance-tokio-local-disk 270525 272744 0.99
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 686695 710899 0.97
random-access/nested-lists/correlated/parquet-tokio-local-disk 143565394 138290000 1.04
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 137033292 137808988 0.99
random-access/nested-lists/correlated/vortex-tokio-local-disk 898619 889610 1.01
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 769607 898116 0.86
random-access/nested-lists/uniform/lance-tokio-local-disk 1207319 1208360 1.00
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1679859 1687080 1.00
random-access/nested-lists/uniform/parquet-tokio-local-disk 137168897 138377839 0.99
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 141152160 138491998 1.02
random-access/nested-lists/uniform/vortex-tokio-local-disk 2637946 2687391 0.98
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2751791 2755151 1.00
random-access/nested-structs/correlated/lance-tokio-local-disk 434256 441524 0.98
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 637336 654629 0.97
random-access/nested-structs/correlated/parquet-tokio-local-disk 26651408 26422107 1.01
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 26540733 26687739 0.99
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚨 1690646 903287 1.87
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚨 1455236 940403 1.55
random-access/nested-structs/uniform/lance-tokio-local-disk 2976481 2953548 1.01
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3223420 3181858 1.01
random-access/nested-structs/uniform/parquet-tokio-local-disk 26474065 26446785 1.00
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 26462266 26513019 1.00
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚨 4968226 1889442 2.63
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 🚨 5006922 1872885 2.67
random-access/parquet-tokio-local-disk 183818526 182495116 1.01
random-access/parquet-tokio-local-disk-footer 183030916 182299291 1.00
random-access/taxi/correlated/lance-tokio-local-disk 976021 980421 1.00
random-access/taxi/correlated/lance-tokio-local-disk-footer 1665796 1669242 1.00
random-access/taxi/correlated/parquet-tokio-local-disk 271990106 276497911 0.98
random-access/taxi/correlated/parquet-tokio-local-disk-footer 276351233 276901278 1.00
random-access/taxi/correlated/vortex-tokio-local-disk 2781456 2909211 0.96
random-access/taxi/correlated/vortex-tokio-local-disk-footer 2914938 3009674 0.97
random-access/taxi/uniform/lance-tokio-local-disk 8966392 8533085 1.05
random-access/taxi/uniform/lance-tokio-local-disk-footer 9580702 9220853 1.04
random-access/taxi/uniform/parquet-tokio-local-disk 287364193 287474027 1.00
random-access/taxi/uniform/parquet-tokio-local-disk-footer 292866306 286357277 1.02
random-access/taxi/uniform/vortex-tokio-local-disk 🚨 15887675 5897406 2.69
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚨 16037790 5881225 2.73
random-access/vortex-tokio-local-disk 2117274 2001985 1.06
random-access/vortex-tokio-local-disk-footer 🚨 2210824 1995307 1.11

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 15, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: Likely regression (medium confidence)
Attributed Vortex impact: +27.3%
Vortex (geomean): 1.445x ❌
Parquet (geomean): 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish +8.4%

datafusion / vortex-file-compressed (1.437x ❌, 0↑ 16↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 421814967 393720036 1.07
tpch_q02/datafusion:vortex-file-compressed 🚨 130687526 115138820 1.14
tpch_q03/datafusion:vortex-file-compressed 🚨 290996260 213768083 1.36
tpch_q04/datafusion:vortex-file-compressed 🚨 193733989 108866988 1.78
tpch_q05/datafusion:vortex-file-compressed 🚨 439546373 386186470 1.14
tpch_q06/datafusion:vortex-file-compressed 🚨 145273073 40367929 3.60
tpch_q07/datafusion:vortex-file-compressed 🚨 619910110 561056860 1.10
tpch_q08/datafusion:vortex-file-compressed 🚨 438041435 381313564 1.15
tpch_q09/datafusion:vortex-file-compressed 715074344 664703365 1.08
tpch_q10/datafusion:vortex-file-compressed 🚨 340298601 243061067 1.40
tpch_q11/datafusion:vortex-file-compressed 🚨 96634079 84846294 1.14
tpch_q12/datafusion:vortex-file-compressed 🚨 269737692 116131208 2.32
tpch_q13/datafusion:vortex-file-compressed 220180579 216918702 1.02
tpch_q14/datafusion:vortex-file-compressed 🚨 166267922 56615180 2.94
tpch_q15/datafusion:vortex-file-compressed 🚨 230064309 105556082 2.18
tpch_q16/datafusion:vortex-file-compressed 🚨 88980790 76006074 1.17
tpch_q17/datafusion:vortex-file-compressed 684303469 637834858 1.07
tpch_q18/datafusion:vortex-file-compressed 915644928 880971294 1.04
tpch_q19/datafusion:vortex-file-compressed 🚨 271741709 92006839 2.95
tpch_q20/datafusion:vortex-file-compressed 🚨 257386744 170782624 1.51
tpch_q21/datafusion:vortex-file-compressed 🚨 808823223 685243167 1.18
tpch_q22/datafusion:vortex-file-compressed 66435519 61791848 1.08
datafusion / vortex-compact (1.399x ❌, 0↑ 17↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 607099727 448417419 1.35
tpch_q02/datafusion:vortex-compact 🚨 131853155 119426732 1.10
tpch_q03/datafusion:vortex-compact 🚨 304679010 217175904 1.40
tpch_q04/datafusion:vortex-compact 🚨 220343082 119416607 1.85
tpch_q05/datafusion:vortex-compact 🚨 463740232 390297670 1.19
tpch_q06/datafusion:vortex-compact 🚨 172360154 63012195 2.74
tpch_q07/datafusion:vortex-compact 🚨 655550736 584929782 1.12
tpch_q08/datafusion:vortex-compact 🚨 462198773 384595070 1.20
tpch_q09/datafusion:vortex-compact 741877937 679126592 1.09
tpch_q10/datafusion:vortex-compact 🚨 374764353 274451507 1.37
tpch_q11/datafusion:vortex-compact 🚨 100641779 89705776 1.12
tpch_q12/datafusion:vortex-compact 🚨 332043281 165340351 2.01
tpch_q13/datafusion:vortex-compact 268767909 269041606 1.00
tpch_q14/datafusion:vortex-compact 🚨 187927166 73412561 2.56
tpch_q15/datafusion:vortex-compact 🚨 287706664 162437094 1.77
tpch_q16/datafusion:vortex-compact 🚨 94249142 81620499 1.15
tpch_q17/datafusion:vortex-compact 700266622 642385079 1.09
tpch_q18/datafusion:vortex-compact 943800115 882253744 1.07
tpch_q19/datafusion:vortex-compact 🚨 340071902 133619228 2.55
tpch_q20/datafusion:vortex-compact 🚨 287110682 198475336 1.45
tpch_q21/datafusion:vortex-compact 🚨 866926966 705366318 1.23
tpch_q22/datafusion:vortex-compact 73783218 72054009 1.02
datafusion / parquet (1.009x ➖, 0↑ 0↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 409650730 410749300 1.00
tpch_q02/datafusion:parquet 185787011 181896733 1.02
tpch_q03/datafusion:parquet 296316721 295980918 1.00
tpch_q04/datafusion:parquet 136398548 134577875 1.01
tpch_q05/datafusion:parquet 456358183 446080543 1.02
tpch_q06/datafusion:parquet 120212118 117268457 1.03
tpch_q07/datafusion:parquet 630592180 624904525 1.01
tpch_q08/datafusion:parquet 503279596 491418383 1.02
tpch_q09/datafusion:parquet 782513964 778282989 1.01
tpch_q10/datafusion:parquet 509364522 503972802 1.01
tpch_q11/datafusion:parquet 129718816 130988620 0.99
tpch_q12/datafusion:parquet 203725312 201468440 1.01
tpch_q13/datafusion:parquet 344845438 341190613 1.01
tpch_q14/datafusion:parquet 160967800 164506390 0.98
tpch_q15/datafusion:parquet 248647087 245059435 1.01
tpch_q16/datafusion:parquet 139227412 134584161 1.03
tpch_q17/datafusion:parquet 693058559 691735806 1.00
tpch_q18/datafusion:parquet 899933502 883607364 1.02
tpch_q19/datafusion:parquet 266385079 265163351 1.00
tpch_q20/datafusion:parquet 308710781 305676032 1.01
tpch_q21/datafusion:parquet 731686077 739840030 0.99
tpch_q22/datafusion:parquet 217027328 216834062 1.00
datafusion / arrow (0.985x ➖, 1↑ 0↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 590308024 595012149 0.99
tpch_q02/datafusion:arrow 162873908 162068402 1.00
tpch_q03/datafusion:arrow 441677420 439431783 1.01
tpch_q04/datafusion:arrow 333026778 338893010 0.98
tpch_q05/datafusion:arrow 872688456 880436362 0.99
tpch_q06/datafusion:arrow 258371895 262623612 0.98
tpch_q07/datafusion:arrow 1082203803 1096991740 0.99
tpch_q08/datafusion:arrow 1062353212 1078803918 0.98
tpch_q09/datafusion:arrow 1274430313 1278759287 1.00
tpch_q10/datafusion:arrow 576840335 584067943 0.99
tpch_q11/datafusion:arrow 143779002 147600167 0.97
tpch_q12/datafusion:arrow 🚀 637110299 738613384 0.86
tpch_q13/datafusion:arrow 508917682 538285003 0.95
tpch_q14/datafusion:arrow 285993631 290735690 0.98
tpch_q15/datafusion:arrow 617731870 619434222 1.00
tpch_q16/datafusion:arrow 105527779 103077642 1.02
tpch_q17/datafusion:arrow 1269214791 1290302778 0.98
tpch_q18/datafusion:arrow 1784152179 1771662873 1.01
tpch_q19/datafusion:arrow 481511134 488546525 0.99
tpch_q20/datafusion:arrow 465802961 475457793 0.98
tpch_q21/datafusion:arrow 2770058256 2764010908 1.00
tpch_q22/datafusion:arrow 139704957 137047671 1.02
duckdb / vortex-file-compressed (1.478x ❌, 0↑ 19↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 257240820 179636876 1.43
tpch_q02/duckdb:vortex-file-compressed 🚨 76047123 54177273 1.40
tpch_q03/duckdb:vortex-file-compressed 🚨 198701122 134710841 1.48
tpch_q04/duckdb:vortex-file-compressed 🚨 205458269 159719441 1.29
tpch_q05/duckdb:vortex-file-compressed 🚨 168571535 130268354 1.29
tpch_q06/duckdb:vortex-file-compressed 🚨 215733238 50132365 4.30
tpch_q07/duckdb:vortex-file-compressed 🚨 242104853 154925551 1.56
tpch_q08/duckdb:vortex-file-compressed 🚨 219146779 188346868 1.16
tpch_q09/duckdb:vortex-file-compressed 372042235 341212170 1.09
tpch_q10/duckdb:vortex-file-compressed 🚨 236874662 166135491 1.43
tpch_q11/duckdb:vortex-file-compressed 🚨 50856530 34849581 1.46
tpch_q12/duckdb:vortex-file-compressed 🚨 268387153 98170461 2.73
tpch_q13/duckdb:vortex-file-compressed 251410100 246634997 1.02
tpch_q14/duckdb:vortex-file-compressed 🚨 198229303 72177672 2.75
tpch_q15/duckdb:vortex-file-compressed 🚨 140623379 97069710 1.45
tpch_q16/duckdb:vortex-file-compressed 🚨 88624809 80495298 1.10
tpch_q17/duckdb:vortex-file-compressed 🚨 154941779 104358396 1.48
tpch_q18/duckdb:vortex-file-compressed 332887042 303487212 1.10
tpch_q19/duckdb:vortex-file-compressed 🚨 160169096 90889024 1.76
tpch_q20/duckdb:vortex-file-compressed 🚨 226323938 165721228 1.37
tpch_q21/duckdb:vortex-file-compressed 🚨 695270353 594727051 1.17
tpch_q22/duckdb:vortex-file-compressed 🚨 84479545 76166567 1.11
duckdb / vortex-compact (1.465x ❌, 0↑ 19↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚨 460250905 229274396 2.01
tpch_q02/duckdb:vortex-compact 🚨 80936176 58735197 1.38
tpch_q03/duckdb:vortex-compact 🚨 229822633 139783866 1.64
tpch_q04/duckdb:vortex-compact 🚨 241249538 174174789 1.39
tpch_q05/duckdb:vortex-compact 🚨 197893368 147873978 1.34
tpch_q06/duckdb:vortex-compact 🚨 257505959 84462638 3.05
tpch_q07/duckdb:vortex-compact 🚨 317268020 201798523 1.57
tpch_q08/duckdb:vortex-compact 🚨 250032162 192211507 1.30
tpch_q09/duckdb:vortex-compact 🚨 423184732 361015444 1.17
tpch_q10/duckdb:vortex-compact 🚨 279471547 190726232 1.47
tpch_q11/duckdb:vortex-compact 🚨 53796948 42314311 1.27
tpch_q12/duckdb:vortex-compact 🚨 381173891 201849316 1.89
tpch_q13/duckdb:vortex-compact 296653691 294406762 1.01
tpch_q14/duckdb:vortex-compact 🚨 237946222 104156536 2.28
tpch_q15/duckdb:vortex-compact 🚨 167938177 119523527 1.41
tpch_q16/duckdb:vortex-compact 95756339 88988676 1.08
tpch_q17/duckdb:vortex-compact 🚨 173997906 117805510 1.48
tpch_q18/duckdb:vortex-compact 🚨 346985382 290246516 1.20
tpch_q19/duckdb:vortex-compact 🚨 195045707 114434442 1.70
tpch_q20/duckdb:vortex-compact 🚨 282047613 207233869 1.36
tpch_q21/duckdb:vortex-compact 🚨 823026391 623373943 1.32
tpch_q22/duckdb:vortex-compact 97954897 89345733 1.10
duckdb / parquet (0.995x ➖, 1↑ 0↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 256645164 263510465 0.97
tpch_q02/duckdb:parquet 104868383 98979649 1.06
tpch_q03/duckdb:parquet 208383546 218622378 0.95
tpch_q04/duckdb:parquet 137077372 136819277 1.00
tpch_q05/duckdb:parquet 220416825 217670133 1.01
tpch_q06/duckdb:parquet 67815402 66611862 1.02
tpch_q07/duckdb:parquet 179707231 179742087 1.00
tpch_q08/duckdb:parquet 252093374 257023943 0.98
tpch_q09/duckdb:parquet 458719318 456288006 1.01
tpch_q10/duckdb:parquet 604431879 598902605 1.01
tpch_q11/duckdb:parquet 42984962 45018903 0.95
tpch_q12/duckdb:parquet 125628333 125585230 1.00
tpch_q13/duckdb:parquet 🚀 407473405 456241952 0.89
tpch_q14/duckdb:parquet 174406744 171301897 1.02
tpch_q15/duckdb:parquet 97466424 97192838 1.00
tpch_q16/duckdb:parquet 163692365 156427938 1.05
tpch_q17/duckdb:parquet 176870435 179016865 0.99
tpch_q18/duckdb:parquet 349843366 351126879 1.00
tpch_q19/duckdb:parquet 283994402 276699079 1.03
tpch_q20/duckdb:parquet 227908391 232907774 0.98
tpch_q21/duckdb:parquet 567547430 576521593 0.98
tpch_q22/duckdb:parquet 293562053 291305703 1.01
duckdb / duckdb (1.002x ➖, 0↑ 0↓)
name PR 39d4ffa (ns) base 89de477 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116339378 116673546 1.00
tpch_q02/duckdb:duckdb 45625181 47004549 0.97
tpch_q03/duckdb:duckdb 96531828 96677912 1.00
tpch_q04/duckdb:duckdb 130809198 132076019 0.99
tpch_q05/duckdb:duckdb 108190075 107999696 1.00
tpch_q06/duckdb:duckdb 37329453 39194382 0.95
tpch_q07/duckdb:duckdb 87605498 85368792 1.03
tpch_q08/duckdb:duckdb 109718180 110354864 0.99
tpch_q09/duckdb:duckdb 278406658 279333515 1.00
tpch_q10/duckdb:duckdb 202364964 207131309 0.98
tpch_q11/duckdb:duckdb 15955301 15206229 1.05
tpch_q12/duckdb:duckdb 84042095 83680051 1.00
tpch_q13/duckdb:duckdb 248061184 252286563 0.98
tpch_q14/duckdb:duckdb 71000512 69844954 1.02
tpch_q15/duckdb:duckdb 78236330 78154648 1.00
tpch_q16/duckdb:duckdb 72746715 73477863 0.99
tpch_q17/duckdb:duckdb 84140400 84168073 1.00
tpch_q18/duckdb:duckdb 214198635 213133805 1.00
tpch_q19/duckdb:duckdb 116687235 114346215 1.02
tpch_q20/duckdb:duckdb 111527251 111754975 1.00
tpch_q21/duckdb:duckdb 303096285 295160825 1.03
tpch_q22/duckdb:duckdb 68289560 64729713 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -0.8% -1.4% +0.7% +10.0% ➖ noise
1 datafusion:vortex-compact +35.4% -1.4% +37.4% +10.0% 🚨 regression
1 datafusion:vortex-file-compressed +7.1% -1.4% +8.7% +10.0% ➖ noise
1 duckdb:duckdb -0.3% -1.4% +1.2% +10.0% ➖ noise
1 duckdb:vortex-compact +100.7% -1.4% +103.7% +10.0% 🚨 regression
1 duckdb:vortex-file-compressed +43.2% -1.4% +45.3% +10.0% 🚨 regression
2 datafusion:arrow +0.5% +4.0% -3.4% +10.0% ➖ noise
2 datafusion:vortex-compact +10.4% +4.0% +6.1% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +13.5% +4.0% +9.1% +10.0% ➖ noise
2 duckdb:duckdb -2.9% +4.0% -6.7% +12.2% ➖ noise
2 duckdb:vortex-compact +37.8% +4.0% +32.5% +10.0% 🚨 regression
2 duckdb:vortex-file-compressed +40.4% +4.0% +34.9% +10.5% 🚨 regression
3 datafusion:arrow +0.5% -2.3% +2.9% +10.0% ➖ noise
3 datafusion:vortex-compact +40.3% -2.3% +43.6% +10.0% 🚨 regression
3 datafusion:vortex-file-compressed +36.1% -2.3% +39.4% +10.0% 🚨 regression
3 duckdb:duckdb -0.2% -2.3% +2.2% +10.0% ➖ noise
3 duckdb:vortex-compact +64.4% -2.3% +68.3% +10.0% 🚨 regression
3 duckdb:vortex-file-compressed +47.5% -2.3% +51.0% +10.0% 🚨 regression
4 datafusion:arrow -1.7% +0.8% -2.5% +10.0% ➖ noise
4 datafusion:vortex-compact +84.5% +0.8% +83.1% +15.2% 🚨 regression
4 datafusion:vortex-file-compressed +78.0% +0.8% +76.6% +10.0% 🚨 regression
4 duckdb:duckdb -1.0% +0.8% -1.7% +10.0% ➖ noise
4 duckdb:vortex-compact +38.5% +0.8% +37.5% +10.0% 🚨 regression
4 duckdb:vortex-file-compressed +28.6% +0.8% +27.7% +10.0% 🚨 regression
5 datafusion:arrow -0.9% +1.8% -2.6% +10.0% ➖ noise
5 datafusion:vortex-compact +18.8% +1.8% +16.7% +10.0% 🚨 regression
5 datafusion:vortex-file-compressed +13.8% +1.8% +11.8% +10.0% 🚨 regression
5 duckdb:duckdb +0.2% +1.8% -1.6% +10.0% ➖ noise
5 duckdb:vortex-compact +33.8% +1.8% +31.5% +10.0% 🚨 regression
5 duckdb:vortex-file-compressed +29.4% +1.8% +27.1% +10.0% 🚨 regression
6 datafusion:arrow -1.6% +2.2% -3.7% +10.0% ➖ noise
6 datafusion:vortex-compact +173.5% +2.2% +167.8% +10.0% 🚨 regression
6 datafusion:vortex-file-compressed +259.9% +2.2% +252.3% +10.0% 🚨 regression
6 duckdb:duckdb -4.8% +2.2% -6.8% +12.1% ➖ noise
6 duckdb:vortex-compact +204.9% +2.2% +198.4% +10.0% 🚨 regression
6 duckdb:vortex-file-compressed +330.3% +2.2% +321.2% +10.0% 🚨 regression
7 datafusion:arrow -1.3% +0.4% -1.8% +10.0% ➖ noise
7 datafusion:vortex-compact +12.1% +0.4% +11.6% +10.0% 🚨 regression
7 datafusion:vortex-file-compressed +10.5% +0.4% +10.0% +10.0% 🚨 regression
7 duckdb:duckdb +2.6% +0.4% +2.2% +10.0% ➖ noise
7 duckdb:vortex-compact +57.2% +0.4% +56.5% +10.0% 🚨 regression
7 duckdb:vortex-file-compressed +56.3% +0.4% +55.6% +10.0% 🚨 regression
8 datafusion:arrow -1.5% +0.2% -1.7% +10.0% ➖ noise
8 datafusion:vortex-compact +20.2% +0.2% +19.9% +10.0% 🚨 regression
8 datafusion:vortex-file-compressed +14.9% +0.2% +14.6% +10.0% 🚨 regression
8 duckdb:duckdb -0.6% +0.2% -0.8% +10.0% ➖ noise
8 duckdb:vortex-compact +30.1% +0.2% +29.8% +10.0% 🚨 regression
8 duckdb:vortex-file-compressed +16.4% +0.2% +16.1% +10.0% 🚨 regression
9 datafusion:arrow -0.3% +0.5% -0.9% +10.0% ➖ noise
9 datafusion:vortex-compact +9.2% +0.5% +8.7% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +7.6% +0.5% +7.0% +10.0% ➖ noise
9 duckdb:duckdb -0.3% +0.5% -0.9% +10.0% ➖ noise
9 duckdb:vortex-compact +17.2% +0.5% +16.6% +10.0% 🚨 regression
9 duckdb:vortex-file-compressed +9.0% +0.5% +8.5% +10.0% ➖ noise
10 datafusion:arrow -1.2% +1.0% -2.2% +10.0% ➖ noise
10 datafusion:vortex-compact +36.6% +1.0% +35.2% +10.0% 🚨 regression
10 datafusion:vortex-file-compressed +40.0% +1.0% +38.6% +10.0% 🚨 regression
10 duckdb:duckdb -2.3% +1.0% -3.3% +10.0% ➖ noise
10 duckdb:vortex-compact +46.5% +1.0% +45.1% +10.0% 🚨 regression
10 duckdb:vortex-file-compressed +42.6% +1.0% +41.2% +10.0% 🚨 regression
11 datafusion:arrow -2.6% -2.8% +0.2% +10.0% ➖ noise
11 datafusion:vortex-compact +12.2% -2.8% +15.4% +10.0% 🚨 regression
11 datafusion:vortex-file-compressed +13.9% -2.8% +17.1% +10.0% 🚨 regression
11 duckdb:duckdb +4.9% -2.8% +7.9% +16.5% ➖ noise
11 duckdb:vortex-compact +27.1% -2.8% +30.7% +11.1% 🚨 regression
11 duckdb:vortex-file-compressed +45.9% -2.8% +50.1% +10.5% 🚨 regression
12 datafusion:arrow -13.7% +0.6% -14.2% +42.6% ➖ noise
12 datafusion:vortex-compact +100.8% +0.6% +99.7% +10.0% 🚨 regression
12 datafusion:vortex-file-compressed +132.3% +0.6% +130.9% +10.0% 🚨 regression
12 duckdb:duckdb +0.4% +0.6% -0.1% +10.0% ➖ noise
12 duckdb:vortex-compact +88.8% +0.6% +87.8% +10.0% 🚨 regression
12 duckdb:vortex-file-compressed +173.4% +0.6% +171.8% +10.0% 🚨 regression
13 datafusion:arrow -5.5% -5.0% -0.5% +10.0% ➖ noise
13 datafusion:vortex-compact -0.1% -5.0% +5.1% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +1.5% -5.0% +6.8% +10.0% ➖ noise
13 duckdb:duckdb -1.7% -5.0% +3.5% +10.0% ➖ noise
13 duckdb:vortex-compact +0.8% -5.0% +6.1% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +1.9% -5.0% +7.3% +10.0% ➖ noise
14 datafusion:arrow -1.6% -0.2% -1.4% +10.0% ➖ noise
14 datafusion:vortex-compact +156.0% -0.2% +156.5% +10.4% 🚨 regression
14 datafusion:vortex-file-compressed +193.7% -0.2% +194.2% +12.1% 🚨 regression
14 duckdb:duckdb +1.7% -0.2% +1.8% +10.0% ➖ noise
14 duckdb:vortex-compact +128.5% -0.2% +128.9% +10.0% 🚨 regression
14 duckdb:vortex-file-compressed +174.6% -0.2% +175.2% +10.0% 🚨 regression
15 datafusion:arrow -0.3% +0.9% -1.1% +10.0% ➖ noise
15 datafusion:vortex-compact +77.1% +0.9% +75.6% +10.0% 🚨 regression
15 datafusion:vortex-file-compressed +118.0% +0.9% +116.1% +10.0% 🚨 regression
15 duckdb:duckdb +0.1% +0.9% -0.8% +10.0% ➖ noise
15 duckdb:vortex-compact +40.5% +0.9% +39.3% +10.0% 🚨 regression
15 duckdb:vortex-file-compressed +44.9% +0.9% +43.6% +10.0% 🚨 regression
16 datafusion:arrow +2.4% +4.0% -1.6% +10.1% ➖ noise
16 datafusion:vortex-compact +15.5% +4.0% +11.0% +10.0% 🚨 regression
16 datafusion:vortex-file-compressed +17.1% +4.0% +12.5% +10.0% 🚨 regression
16 duckdb:duckdb -1.0% +4.0% -4.8% +10.0% ➖ noise
16 duckdb:vortex-compact +7.6% +4.0% +3.4% +10.1% ➖ noise
16 duckdb:vortex-file-compressed +10.1% +4.0% +5.8% +10.0% ➖ noise
17 datafusion:arrow -1.6% -0.5% -1.1% +10.0% ➖ noise
17 datafusion:vortex-compact +9.0% -0.5% +9.6% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +7.3% -0.5% +7.8% +10.0% ➖ noise
17 duckdb:duckdb -0.0% -0.5% +0.5% +10.0% ➖ noise
17 duckdb:vortex-compact +47.7% -0.5% +48.5% +10.0% 🚨 regression
17 duckdb:vortex-file-compressed +48.5% -0.5% +49.2% +10.0% 🚨 regression
18 datafusion:arrow +0.7% +0.7% -0.0% +10.0% ➖ noise
18 datafusion:vortex-compact +7.0% +0.7% +6.2% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +3.9% +0.7% +3.2% +10.0% ➖ noise
18 duckdb:duckdb +0.5% +0.7% -0.2% +10.0% ➖ noise
18 duckdb:vortex-compact +19.5% +0.7% +18.7% +10.0% 🚨 regression
18 duckdb:vortex-file-compressed +9.7% +0.7% +8.9% +10.0% ➖ noise
19 datafusion:arrow -1.4% +1.5% -2.9% +10.0% ➖ noise
19 datafusion:vortex-compact +154.5% +1.5% +150.6% +10.0% 🚨 regression
19 datafusion:vortex-file-compressed +195.3% +1.5% +190.9% +10.0% 🚨 regression
19 duckdb:duckdb +2.0% +1.5% +0.5% +10.0% ➖ noise
19 duckdb:vortex-compact +70.4% +1.5% +67.9% +10.0% 🚨 regression
19 duckdb:vortex-file-compressed +76.2% +1.5% +73.5% +10.0% 🚨 regression
20 datafusion:arrow -2.0% -0.6% -1.4% +10.0% ➖ noise
20 datafusion:vortex-compact +44.7% -0.6% +45.5% +10.0% 🚨 regression
20 datafusion:vortex-file-compressed +50.7% -0.6% +51.6% +10.0% 🚨 regression
20 duckdb:duckdb -0.2% -0.6% +0.4% +10.0% ➖ noise
20 duckdb:vortex-compact +36.1% -0.6% +36.9% +10.0% 🚨 regression
20 duckdb:vortex-file-compressed +36.6% -0.6% +37.4% +10.0% 🚨 regression
21 datafusion:arrow +0.2% -1.3% +1.6% +10.0% ➖ noise
21 datafusion:vortex-compact +22.9% -1.3% +24.6% +10.0% 🚨 regression
21 datafusion:vortex-file-compressed +18.0% -1.3% +19.6% +10.0% 🚨 regression
21 duckdb:duckdb +2.7% -1.3% +4.1% +10.0% ➖ noise
21 duckdb:vortex-compact +32.0% -1.3% +33.8% +10.0% 🚨 regression
21 duckdb:vortex-file-compressed +16.9% -1.3% +18.5% +10.0% 🚨 regression
22 datafusion:arrow +1.9% +0.4% +1.5% +10.0% ➖ noise
22 datafusion:vortex-compact +2.4% +0.4% +2.0% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +7.5% +0.4% +7.1% +10.0% ➖ noise
22 duckdb:duckdb +5.5% +0.4% +5.0% +10.0% ➖ noise
22 duckdb:vortex-compact +9.6% +0.4% +9.2% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +10.9% +0.4% +10.4% +10.0% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 15, 2026

File Sizes: TPC-H SF=10 on NVME

File Size Changes (48 files changed, +1.1% overall, 41↑ 7↓)
File Scale Format Base HEAD Change %
partsupp_0.vortex 10.0 vortex-file-compressed 180.30 MB 185.29 MB +4.99 MB +2.8%
partsupp_1.vortex 10.0 vortex-file-compressed 180.47 MB 185.47 MB +4.99 MB +2.8%
lineitem_6.vortex 10.0 vortex-file-compressed 132.98 MB 136.08 MB +3.11 MB +2.3%
lineitem_5.vortex 10.0 vortex-file-compressed 133.59 MB 136.18 MB +2.59 MB +1.9%
lineitem_3.vortex 10.0 vortex-file-compressed 133.48 MB 136.06 MB +2.58 MB +1.9%
lineitem_7.vortex 10.0 vortex-file-compressed 133.73 MB 135.96 MB +2.23 MB +1.7%
lineitem_8.vortex 10.0 vortex-file-compressed 133.78 MB 135.99 MB +2.21 MB +1.7%
lineitem_1.vortex 10.0 vortex-file-compressed 133.98 MB 136.04 MB +2.06 MB +1.5%
lineitem_12.vortex 10.0 vortex-file-compressed 134.22 MB 136.12 MB +1.90 MB +1.4%
lineitem_4.vortex 10.0 vortex-file-compressed 134.13 MB 136.03 MB +1.90 MB +1.4%
lineitem_2.vortex 10.0 vortex-file-compressed 134.09 MB 135.98 MB +1.89 MB +1.4%
lineitem_10.vortex 10.0 vortex-file-compressed 134.21 MB 136.10 MB +1.89 MB +1.4%
lineitem_0.vortex 10.0 vortex-compact 100.39 MB 101.79 MB +1.40 MB +1.4%
lineitem_12.vortex 10.0 vortex-compact 100.42 MB 101.81 MB +1.39 MB +1.4%
lineitem_4.vortex 10.0 vortex-compact 100.35 MB 101.74 MB +1.38 MB +1.4%
lineitem_3.vortex 10.0 vortex-compact 100.41 MB 101.79 MB +1.37 MB +1.4%
lineitem_11.vortex 10.0 vortex-compact 100.32 MB 101.68 MB +1.36 MB +1.4%
lineitem_9.vortex 10.0 vortex-compact 100.26 MB 101.62 MB +1.36 MB +1.4%
lineitem_7.vortex 10.0 vortex-compact 100.38 MB 101.73 MB +1.35 MB +1.3%
lineitem_10.vortex 10.0 vortex-compact 100.42 MB 101.76 MB +1.35 MB +1.3%
lineitem_5.vortex 10.0 vortex-compact 100.50 MB 101.84 MB +1.35 MB +1.3%
lineitem_6.vortex 10.0 vortex-compact 100.48 MB 101.82 MB +1.34 MB +1.3%
lineitem_8.vortex 10.0 vortex-compact 100.39 MB 101.72 MB +1.33 MB +1.3%
lineitem_2.vortex 10.0 vortex-compact 100.38 MB 101.71 MB +1.32 MB +1.3%
lineitem_1.vortex 10.0 vortex-compact 100.44 MB 101.75 MB +1.31 MB +1.3%
lineitem_0.vortex 10.0 vortex-file-compressed 134.36 MB 136.07 MB +1.71 MB +1.3%
lineitem_9.vortex 10.0 vortex-file-compressed 134.36 MB 135.88 MB +1.52 MB +1.1%
lineitem_11.vortex 10.0 vortex-file-compressed 134.56 MB 135.92 MB +1.36 MB +1.0%
orders_1.vortex 10.0 vortex-compact 114.53 MB 115.03 MB +510.65 KB +0.4%
orders_2.vortex 10.0 vortex-compact 114.55 MB 115.04 MB +502.43 KB +0.4%
orders_0.vortex 10.0 vortex-compact 114.56 MB 115.05 MB +502.39 KB +0.4%
part_0.vortex 10.0 vortex-compact 18.06 MB 18.13 MB +76.23 KB +0.4%
part_1.vortex 10.0 vortex-compact 18.06 MB 18.13 MB +75.99 KB +0.4%
part_1.vortex 10.0 vortex-file-compressed 26.92 MB 27.01 MB +92.39 KB +0.3%
part_0.vortex 10.0 vortex-file-compressed 26.95 MB 27.04 MB +92.39 KB +0.3%
partsupp_1.vortex 10.0 vortex-compact 126.64 MB 126.87 MB +237.62 KB +0.2%
partsupp_0.vortex 10.0 vortex-compact 126.66 MB 126.89 MB +236.66 KB +0.2%
customer_0.vortex 10.0 vortex-compact 74.01 MB 74.11 MB +105.10 KB +0.1%
supplier_0.vortex 10.0 vortex-compact 4.72 MB 4.72 MB +6.65 KB +0.1%
supplier_0.vortex 10.0 vortex-file-compressed 6.67 MB 6.68 MB +8.27 KB +0.1%
customer_0.vortex 10.0 vortex-file-compressed 104.54 MB 104.67 MB +128.98 KB +0.1%
orders_1.vortex 10.0 vortex-file-compressed 163.75 MB 161.98 MB 1.77 MB -1.1%
orders_2.vortex 10.0 vortex-file-compressed 163.59 MB 161.82 MB 1.77 MB -1.1%
orders_0.vortex 10.0 vortex-file-compressed 163.53 MB 161.76 MB 1.77 MB -1.1%
nation_0.vortex 10.0 vortex-file-compressed 8.38 KB 8.17 KB 216 B -2.5%
nation_0.vortex 10.0 vortex-compact 6.30 KB 6.09 KB 216 B -3.3%
region_0.vortex 10.0 vortex-file-compressed 4.78 KB 4.56 KB 224 B -4.6%
region_0.vortex 10.0 vortex-compact 4.52 KB 4.30 KB 224 B -4.8%

Totals:

  • vortex-compact: 1.97 GB → 1.99 GB (+1.0%)
  • vortex-file-compressed: 2.69 GB → 2.73 GB (+1.2%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 15, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +9.8%
Vortex (geomean): 1.218x ❌
Parquet (geomean): 1.021x ➖
Shifts: Parquet (control) +2.1% · Median polish +1.9%

datafusion / vortex-file-compressed (1.177x ❌, 0↑ 22↓)
name PR 39d4ffa (ns) base 9406303 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1921033 1860198 1.03
clickbench_q01/datafusion:vortex-file-compressed 🚨 18569084 14107604 1.32
clickbench_q02/datafusion:vortex-file-compressed 🚨 40659689 36015616 1.13
clickbench_q03/datafusion:vortex-file-compressed 🚨 50465903 39705815 1.27
clickbench_q04/datafusion:vortex-file-compressed 325124944 308101973 1.06
clickbench_q05/datafusion:vortex-file-compressed 319673087 317066595 1.01
clickbench_q06/datafusion:vortex-file-compressed 1939215 1899039 1.02
clickbench_q07/datafusion:vortex-file-compressed 🚨 25367718 18824232 1.35
clickbench_q08/datafusion:vortex-file-compressed 🚨 431860735 380865010 1.13
clickbench_q09/datafusion:vortex-file-compressed 🚨 664832250 560399683 1.19
clickbench_q10/datafusion:vortex-file-compressed 🚨 132322140 72512262 1.82
clickbench_q11/datafusion:vortex-file-compressed 🚨 158768073 84980421 1.87
clickbench_q12/datafusion:vortex-file-compressed 287496414 268263884 1.07
clickbench_q13/datafusion:vortex-file-compressed 🚨 508097844 412591926 1.23
clickbench_q14/datafusion:vortex-file-compressed 🚨 294670022 259811808 1.13
clickbench_q15/datafusion:vortex-file-compressed 384527515 358931430 1.07
clickbench_q16/datafusion:vortex-file-compressed 745999515 684172202 1.09
clickbench_q17/datafusion:vortex-file-compressed 739210224 679885984 1.09
clickbench_q18/datafusion:vortex-file-compressed 1464662894 1366512302 1.07
clickbench_q19/datafusion:vortex-file-compressed 🚨 32431356 25871541 1.25
clickbench_q20/datafusion:vortex-file-compressed 364709410 353840145 1.03
clickbench_q21/datafusion:vortex-file-compressed 420801733 411730159 1.02
clickbench_q22/datafusion:vortex-file-compressed 538529445 501436886 1.07
clickbench_q23/datafusion:vortex-file-compressed 🚨 940059468 773560452 1.22
clickbench_q24/datafusion:vortex-file-compressed 🚨 98081258 55510715 1.77
clickbench_q25/datafusion:vortex-file-compressed 🚨 93301344 72131811 1.29
clickbench_q26/datafusion:vortex-file-compressed 🚨 88508167 47472776 1.86
clickbench_q27/datafusion:vortex-file-compressed 829726350 803681953 1.03
clickbench_q28/datafusion:vortex-file-compressed 6669605769 6759380361 0.99
clickbench_q29/datafusion:vortex-file-compressed 235444658 242188264 0.97
clickbench_q30/datafusion:vortex-file-compressed 🚨 307061223 243559338 1.26
clickbench_q31/datafusion:vortex-file-compressed 🚨 488165316 275082414 1.77
clickbench_q32/datafusion:vortex-file-compressed 1226808662 1168878832 1.05
clickbench_q33/datafusion:vortex-file-compressed 1436855372 1350512558 1.06
clickbench_q34/datafusion:vortex-file-compressed 1422214283 1373460337 1.04
clickbench_q35/datafusion:vortex-file-compressed 525282729 507187877 1.04
clickbench_q36/datafusion:vortex-file-compressed 84042137 81663280 1.03
clickbench_q37/datafusion:vortex-file-compressed 42111129 38891402 1.08
clickbench_q38/datafusion:vortex-file-compressed 🚨 26309233 22854036 1.15
clickbench_q39/datafusion:vortex-file-compressed 🚨 156491766 142120276 1.10
clickbench_q40/datafusion:vortex-file-compressed 🚨 21852848 19312868 1.13
clickbench_q41/datafusion:vortex-file-compressed 🚨 19894554 16443139 1.21
clickbench_q42/datafusion:vortex-file-compressed 🚨 21070472 18871352 1.12
datafusion / parquet (1.019x ➖, 0↑ 0↓)
name PR 39d4ffa (ns) base 9406303 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1980284 1939696 1.02
clickbench_q01/datafusion:parquet 20334726 20562932 0.99
clickbench_q02/datafusion:parquet 53390247 53289992 1.00
clickbench_q03/datafusion:parquet 45331297 46274325 0.98
clickbench_q04/datafusion:parquet 334729089 329613000 1.02
clickbench_q05/datafusion:parquet 379114827 363756460 1.04
clickbench_q06/datafusion:parquet 1826987 1934798 0.94
clickbench_q07/datafusion:parquet 26007355 25230749 1.03
clickbench_q08/datafusion:parquet 425131051 407425117 1.04
clickbench_q09/datafusion:parquet 675620068 632086569 1.07
clickbench_q10/datafusion:parquet 110937202 113237904 0.98
clickbench_q11/datafusion:parquet 139329894 132721809 1.05
clickbench_q12/datafusion:parquet 367058122 357231199 1.03
clickbench_q13/datafusion:parquet 520575298 495916641 1.05
clickbench_q14/datafusion:parquet 379478369 361238646 1.05
clickbench_q15/datafusion:parquet 382411132 368104449 1.04
clickbench_q16/datafusion:parquet 711699145 682263831 1.04
clickbench_q17/datafusion:parquet 693080541 680731092 1.02
clickbench_q18/datafusion:parquet 1384675033 1382583330 1.00
clickbench_q19/datafusion:parquet 34553113 32773305 1.05
clickbench_q20/datafusion:parquet 635817145 610328849 1.04
clickbench_q21/datafusion:parquet 675496828 662642505 1.02
clickbench_q22/datafusion:parquet 992091374 975164474 1.02
clickbench_q23/datafusion:parquet 3858915951 3649630092 1.06
clickbench_q24/datafusion:parquet 89016522 91775205 0.97
clickbench_q25/datafusion:parquet 139248004 147379843 0.94
clickbench_q26/datafusion:parquet 88985884 88798095 1.00
clickbench_q27/datafusion:parquet 1060877139 1062027823 1.00
clickbench_q28/datafusion:parquet 6597935122 6617276313 1.00
clickbench_q29/datafusion:parquet 241301783 234244238 1.03
clickbench_q30/datafusion:parquet 361219456 364904526 0.99
clickbench_q31/datafusion:parquet 398391976 389889962 1.02
clickbench_q32/datafusion:parquet 1339069845 1285117531 1.04
clickbench_q33/datafusion:parquet 1534930318 1535968856 1.00
clickbench_q34/datafusion:parquet 1541552480 1521975832 1.01
clickbench_q35/datafusion:parquet 536839462 526918760 1.02
clickbench_q36/datafusion:parquet 156135670 145068566 1.08
clickbench_q37/datafusion:parquet 62331056 60425350 1.03
clickbench_q38/datafusion:parquet 92476606 94570559 0.98
clickbench_q39/datafusion:parquet 280243760 274163549 1.02
clickbench_q40/datafusion:parquet 33181924 32875447 1.01
clickbench_q41/datafusion:parquet 31626802 30079663 1.05
clickbench_q42/datafusion:parquet 32347213 31306972 1.03
duckdb / vortex-file-compressed (1.260x ❌, 0↑ 26↓)
name PR 39d4ffa (ns) base 9406303 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6685777 6222430 1.07
clickbench_q01/duckdb:vortex-file-compressed 🚨 25360268 14560730 1.74
clickbench_q02/duckdb:vortex-file-compressed 🚨 37486337 26415557 1.42
clickbench_q03/duckdb:vortex-file-compressed 🚨 53245825 30584415 1.74
clickbench_q04/duckdb:vortex-file-compressed 🚨 212156604 187288936 1.13
clickbench_q05/duckdb:vortex-file-compressed 🚨 219859434 196946457 1.12
clickbench_q06/duckdb:vortex-file-compressed 🚨 69226099 19554115 3.54
clickbench_q07/duckdb:vortex-file-compressed 🚨 28122432 16386103 1.72
clickbench_q08/duckdb:vortex-file-compressed 🚨 314873565 267235800 1.18
clickbench_q09/duckdb:vortex-file-compressed 🚨 430417480 350409407 1.23
clickbench_q10/duckdb:vortex-file-compressed 🚨 144225714 73978282 1.95
clickbench_q11/duckdb:vortex-file-compressed 🚨 175748437 82990329 2.12
clickbench_q12/duckdb:vortex-file-compressed 🚨 244569964 219270359 1.12
clickbench_q13/duckdb:vortex-file-compressed 🚨 549987254 430326439 1.28
clickbench_q14/duckdb:vortex-file-compressed 🚨 316084889 258273024 1.22
clickbench_q15/duckdb:vortex-file-compressed 248383701 230745190 1.08
clickbench_q16/duckdb:vortex-file-compressed 642729648 698024466 0.92
clickbench_q17/duckdb:vortex-file-compressed 543244261 512787932 1.06
clickbench_q18/duckdb:vortex-file-compressed 1279586019 1187893128 1.08
clickbench_q19/duckdb:vortex-file-compressed 🚨 29276508 23715286 1.23
clickbench_q20/duckdb:vortex-file-compressed 🚨 444453390 402804229 1.10
clickbench_q21/duckdb:vortex-file-compressed 454052195 417820865 1.09
clickbench_q22/duckdb:vortex-file-compressed 648522243 698443728 0.93
clickbench_q23/duckdb:vortex-file-compressed 🚨 1662272582 993821949 1.67
clickbench_q24/duckdb:vortex-file-compressed 🚨 70228747 51149654 1.37
clickbench_q25/duckdb:vortex-file-compressed 🚨 99189949 83935006 1.18
clickbench_q26/duckdb:vortex-file-compressed 🚨 76380641 41109031 1.86
clickbench_q27/duckdb:vortex-file-compressed 🚨 674784499 497009786 1.36
clickbench_q28/duckdb:vortex-file-compressed 3129330343 3003425306 1.04
clickbench_q29/duckdb:vortex-file-compressed 🚨 35680250 30761209 1.16
clickbench_q30/duckdb:vortex-file-compressed 🚨 268142172 201738825 1.33
clickbench_q31/duckdb:vortex-file-compressed 🚨 427267939 275039275 1.55
clickbench_q32/duckdb:vortex-file-compressed 1400228605 1461811050 0.96
clickbench_q33/duckdb:vortex-file-compressed 🚨 1969327612 1511589384 1.30
clickbench_q34/duckdb:vortex-file-compressed 🚨 2034946112 1535085431 1.33
clickbench_q35/duckdb:vortex-file-compressed 369195999 373044060 0.99
clickbench_q36/duckdb:vortex-file-compressed 33752312 30944944 1.09
clickbench_q37/duckdb:vortex-file-compressed 24305720 24008665 1.01
clickbench_q38/duckdb:vortex-file-compressed 27071063 25377394 1.07
clickbench_q39/duckdb:vortex-file-compressed 48357598 45766361 1.06
clickbench_q40/duckdb:vortex-file-compressed 25810863 23917395 1.08
clickbench_q41/duckdb:vortex-file-compressed 25005765 23740836 1.05
clickbench_q42/duckdb:vortex-file-compressed 22305832 24259098 0.92
duckdb / parquet (1.024x ➖, 0↑ 1↓)
name PR 39d4ffa (ns) base 9406303 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 219612043 217946730 1.01
clickbench_q01/duckdb:parquet 51622296 50101278 1.03
clickbench_q02/duckdb:parquet 67506137 66219638 1.02
clickbench_q03/duckdb:parquet 65947064 63446021 1.04
clickbench_q04/duckdb:parquet 209656557 204837838 1.02
clickbench_q05/duckdb:parquet 277828110 275379337 1.01
clickbench_q06/duckdb:parquet 61422281 61117963 1.00
clickbench_q07/duckdb:parquet 52600224 53013114 0.99
clickbench_q08/duckdb:parquet 273647803 267808029 1.02
clickbench_q09/duckdb:parquet 400880163 394682919 1.02
clickbench_q10/duckdb:parquet 96505896 95935617 1.01
clickbench_q11/duckdb:parquet 111068296 107304493 1.04
clickbench_q12/duckdb:parquet 299185490 295640267 1.01
clickbench_q13/duckdb:parquet 520444171 504547597 1.03
clickbench_q14/duckdb:parquet 333714532 328319924 1.02
clickbench_q15/duckdb:parquet 244170711 240982849 1.01
clickbench_q16/duckdb:parquet 623462627 610206465 1.02
clickbench_q17/duckdb:parquet 517045081 507950261 1.02
clickbench_q18/duckdb:parquet 1065896579 1049439183 1.02
clickbench_q19/duckdb:parquet 49612569 49744860 1.00
clickbench_q20/duckdb:parquet 439555408 437889552 1.00
clickbench_q21/duckdb:parquet 562595766 553577109 1.02
clickbench_q22/duckdb:parquet 944662857 931762130 1.01
clickbench_q23/duckdb:parquet 318977553 309460349 1.03
clickbench_q24/duckdb:parquet 82052926 77590029 1.06
clickbench_q25/duckdb:parquet 142348153 139245804 1.02
clickbench_q26/duckdb:parquet 53997291 54257856 1.00
clickbench_q27/duckdb:parquet 662849895 640498061 1.03
clickbench_q28/duckdb:parquet 4845810134 4884041113 0.99
clickbench_q29/duckdb:parquet 61803686 60242451 1.03
clickbench_q30/duckdb:parquet 307285132 304674804 1.01
clickbench_q31/duckdb:parquet 352751299 353472281 1.00
clickbench_q32/duckdb:parquet 1144603315 1133493541 1.01
clickbench_q33/duckdb:parquet 1204842726 1208002554 1.00
clickbench_q34/duckdb:parquet 1319015487 1251996009 1.05
clickbench_q35/duckdb:parquet 369629090 352392859 1.05
clickbench_q36/duckdb:parquet 67015339 64315732 1.04
clickbench_q37/duckdb:parquet 56543230 53655789 1.05
clickbench_q38/duckdb:parquet 61673476 58593728 1.05
clickbench_q39/duckdb:parquet 100173063 98387863 1.02
clickbench_q40/duckdb:parquet 59184500 54188063 1.09
clickbench_q41/duckdb:parquet 62396583 59020793 1.06
clickbench_q42/duckdb:parquet 🚨 54727667 49652042 1.10
duckdb / duckdb (0.950x ➖, 8↑ 0↓)
name PR 39d4ffa (ns) base 9406303 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 🚀 18540638 20673354 0.90
clickbench_q01/duckdb:duckdb 32954987 36424653 0.90
clickbench_q02/duckdb:duckdb 45517612 48966668 0.93
clickbench_q03/duckdb:duckdb 47414400 50855408 0.93
clickbench_q04/duckdb:duckdb 215333102 222485670 0.97
clickbench_q05/duckdb:duckdb 327614037 327189646 1.00
clickbench_q06/duckdb:duckdb 35323353 38865707 0.91
clickbench_q07/duckdb:duckdb 🚀 35989600 40433910 0.89
clickbench_q08/duckdb:duckdb 307827038 314602325 0.98
clickbench_q09/duckdb:duckdb 482032205 469551243 1.03
clickbench_q10/duckdb:duckdb 99102445 99177368 1.00
clickbench_q11/duckdb:duckdb 108093559 107146025 1.01
clickbench_q12/duckdb:duckdb 312599084 301176602 1.04
clickbench_q13/duckdb:duckdb 536639933 545603075 0.98
clickbench_q14/duckdb:duckdb 344675777 337864405 1.02
clickbench_q15/duckdb:duckdb 254356516 259889014 0.98
clickbench_q16/duckdb:duckdb 683125458 689165266 0.99
clickbench_q17/duckdb:duckdb 571716079 593486024 0.96
clickbench_q18/duckdb:duckdb 1259107478 1280459785 0.98
clickbench_q19/duckdb:duckdb 34707167 38509088 0.90
clickbench_q20/duckdb:duckdb 🚀 874566484 1040199830 0.84
clickbench_q21/duckdb:duckdb 🚀 934997624 1087343718 0.86
clickbench_q22/duckdb:duckdb 1084962495 1090255276 1.00
clickbench_q23/duckdb:duckdb 259203487 271473518 0.95
clickbench_q24/duckdb:duckdb 61855178 65522657 0.94
clickbench_q25/duckdb:duckdb 123276049 130191496 0.95
clickbench_q26/duckdb:duckdb 56931992 60203234 0.95
clickbench_q27/duckdb:duckdb 🚀 933464906 1091997784 0.85
clickbench_q28/duckdb:duckdb 4616771358 4610057540 1.00
clickbench_q29/duckdb:duckdb 47788072 52235075 0.91
clickbench_q30/duckdb:duckdb 293187039 294817929 0.99
clickbench_q31/duckdb:duckdb 424858013 436199779 0.97
clickbench_q32/duckdb:duckdb 1442133405 1430064980 1.01
clickbench_q33/duckdb:duckdb 1858672968 1889427255 0.98
clickbench_q34/duckdb:duckdb 1993711003 2028108587 0.98
clickbench_q35/duckdb:duckdb 265689508 263419178 1.01
clickbench_q36/duckdb:duckdb 39866447 42806026 0.93
clickbench_q37/duckdb:duckdb 🚀 31390448 34913965 0.90
clickbench_q38/duckdb:duckdb 31335119 34029574 0.92
clickbench_q39/duckdb:duckdb 64007449 68734982 0.93
clickbench_q40/duckdb:duckdb 🚀 31662807 35491907 0.89
clickbench_q41/duckdb:duckdb 30256229 33264279 0.91
clickbench_q42/duckdb:duckdb 🚀 31542556 35570134 0.89
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +3.3% +1.4% +1.8% +683.3% ➖ noise
0 duckdb:duckdb -10.3% +1.4% -11.6% +259.5% ➖ noise
0 duckdb:vortex-file-compressed +7.4% +1.4% +5.9% +324.0% ➖ noise
1 datafusion:vortex-file-compressed +31.6% +0.9% +30.4% +31.0% ➖ noise
1 duckdb:duckdb -9.5% +0.9% -10.4% +58.2% ➖ noise
1 duckdb:vortex-file-compressed +74.2% +0.9% +72.5% +13.3% 🚨 regression
2 datafusion:vortex-file-compressed +12.9% +1.1% +11.7% +15.4% ➖ noise
2 duckdb:duckdb -7.0% +1.1% -8.0% +19.0% ➖ noise
2 duckdb:vortex-file-compressed +41.9% +1.1% +40.4% +12.2% 🚨 regression
3 datafusion:vortex-file-compressed +27.1% +0.9% +26.0% +134.5% ➖ noise
3 duckdb:duckdb -6.8% +0.9% -7.6% +40.2% ➖ noise
3 duckdb:vortex-file-compressed +74.1% +0.9% +72.5% +19.8% 🚨 regression
4 datafusion:vortex-file-compressed +5.5% +2.0% +3.5% +10.0% ➖ noise
4 duckdb:duckdb -3.2% +2.0% -5.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +13.3% +2.0% +11.1% +10.0% 🚨 regression
5 datafusion:vortex-file-compressed +0.8% +2.5% -1.7% +10.0% ➖ noise
5 duckdb:duckdb +0.1% +2.5% -2.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +11.6% +2.5% +8.9% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +2.1% -2.6% +4.8% +40.2% ➖ noise
6 duckdb:duckdb -9.1% -2.6% -6.7% +28.4% ➖ noise
6 duckdb:vortex-file-compressed +254.0% -2.6% +263.4% +16.9% 🚨 regression
7 datafusion:vortex-file-compressed +34.8% +1.1% +33.3% +10.0% 🚨 regression
7 duckdb:duckdb -11.0% +1.1% -12.0% +14.1% ➖ noise
7 duckdb:vortex-file-compressed +71.6% +1.1% +69.7% +10.0% 🚨 regression
8 datafusion:vortex-file-compressed +13.4% +3.3% +9.8% +10.0% ➖ noise
8 duckdb:duckdb -2.2% +3.3% -5.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +17.8% +3.3% +14.1% +10.0% 🚨 regression
9 datafusion:vortex-file-compressed +18.6% +4.2% +13.9% +10.0% 🚨 regression
9 duckdb:duckdb +2.7% +4.2% -1.5% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +22.8% +4.2% +17.9% +10.0% 🚨 regression
10 datafusion:vortex-file-compressed +82.5% -0.7% +83.8% +10.0% 🚨 regression
10 duckdb:duckdb -0.1% -0.7% +0.7% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +95.0% -0.7% +96.4% +10.0% 🚨 regression
11 datafusion:vortex-file-compressed +86.8% +4.2% +79.2% +10.0% 🚨 regression
11 duckdb:duckdb +0.9% +4.2% -3.2% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +111.8% +4.2% +103.2% +10.0% 🚨 regression
12 datafusion:vortex-file-compressed +7.2% +2.0% +5.1% +10.0% ➖ noise
12 duckdb:duckdb +3.8% +2.0% +1.8% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +11.5% +2.0% +9.4% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +23.1% +4.1% +18.3% +10.0% 🚨 regression
13 duckdb:duckdb -1.6% +4.1% -5.5% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +27.8% +4.1% +22.8% +10.0% 🚨 regression
14 datafusion:vortex-file-compressed +13.4% +3.3% +9.8% +10.0% ➖ noise
14 duckdb:duckdb +2.0% +3.3% -1.3% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +22.4% +3.3% +18.4% +10.0% 🚨 regression
15 datafusion:vortex-file-compressed +7.1% +2.6% +4.4% +10.0% ➖ noise
15 duckdb:duckdb -2.1% +2.6% -4.6% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +7.6% +2.6% +4.9% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +9.0% +3.2% +5.6% +10.0% ➖ noise
16 duckdb:duckdb -0.9% +3.2% -4.0% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -7.9% +3.2% -10.8% +10.0% ✅ faster
17 datafusion:vortex-file-compressed +8.7% +1.8% +6.8% +10.0% ➖ noise
17 duckdb:duckdb -3.7% +1.8% -5.4% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +5.9% +1.8% +4.1% +11.2% ➖ noise
18 datafusion:vortex-file-compressed +7.2% +0.9% +6.3% +10.0% ➖ noise
18 duckdb:duckdb -1.7% +0.9% -2.5% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +7.7% +0.9% +6.8% +11.9% ➖ noise
19 datafusion:vortex-file-compressed +25.4% +2.5% +22.2% +17.8% 🚨 regression
19 duckdb:duckdb -9.9% +2.5% -12.1% +11.1% ✅ faster
19 duckdb:vortex-file-compressed +23.4% +2.5% +20.4% +20.2% 🚨 regression
20 datafusion:vortex-file-compressed +3.1% +2.3% +0.8% +195.5% ➖ noise
20 duckdb:duckdb -15.9% +2.3% -17.8% +27.0% ➖ noise
20 duckdb:vortex-file-compressed +10.3% +2.3% +7.9% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +2.2% +1.8% +0.4% +10.0% ➖ noise
21 duckdb:duckdb -14.0% +1.8% -15.5% +10.1% ✅ faster
21 duckdb:vortex-file-compressed +8.7% +1.8% +6.8% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +7.4% +1.6% +5.7% +10.0% ➖ noise
22 duckdb:duckdb -0.5% +1.6% -2.0% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -7.1% +1.6% -8.6% +15.7% ➖ noise
23 datafusion:vortex-file-compressed +21.5% +4.4% +16.4% +31.2% ➖ noise
23 duckdb:duckdb -4.5% +4.4% -8.5% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +67.3% +4.4% +60.2% +11.3% 🚨 regression
24 datafusion:vortex-file-compressed +76.7% +1.3% +74.5% +12.8% 🚨 regression
24 duckdb:duckdb -5.6% +1.3% -6.8% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +37.3% +1.3% +35.6% +46.2% ➖ noise
25 datafusion:vortex-file-compressed +29.3% -1.7% +31.6% +13.3% 🚨 regression
25 duckdb:duckdb -5.3% -1.7% -3.7% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +18.2% -1.7% +20.2% +10.0% 🚨 regression
26 datafusion:vortex-file-compressed +86.4% -0.1% +86.7% +20.0% 🚨 regression
26 duckdb:duckdb -5.4% -0.1% -5.3% +10.5% ➖ noise
26 duckdb:vortex-file-compressed +85.8% -0.1% +86.1% +20.7% 🚨 regression
27 datafusion:vortex-file-compressed +3.2% +1.7% +1.5% +10.0% ➖ noise
27 duckdb:duckdb -14.5% +1.7% -15.9% +10.0% ✅ faster
27 duckdb:vortex-file-compressed +35.8% +1.7% +33.5% +10.0% 🚨 regression
28 datafusion:vortex-file-compressed -1.3% -0.5% -0.8% +10.0% ➖ noise
28 duckdb:duckdb +0.1% -0.5% +0.7% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +4.2% -0.5% +4.8% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -2.8% +2.8% -5.4% +14.5% ➖ noise
29 duckdb:duckdb -8.5% +2.8% -11.0% +10.3% ✅ faster
29 duckdb:vortex-file-compressed +16.0% +2.8% +12.8% +10.0% 🚨 regression
30 datafusion:vortex-file-compressed +26.1% -0.1% +26.2% +10.0% 🚨 regression
30 duckdb:duckdb -0.6% -0.1% -0.5% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +32.9% -0.1% +33.0% +10.0% 🚨 regression
31 datafusion:vortex-file-compressed +77.5% +1.0% +75.7% +10.0% 🚨 regression
31 duckdb:duckdb -2.6% +1.0% -3.5% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +55.3% +1.0% +53.8% +10.0% 🚨 regression
32 datafusion:vortex-file-compressed +5.0% +2.6% +2.3% +10.8% ➖ noise
32 duckdb:duckdb +0.8% +2.6% -1.7% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -4.2% +2.6% -6.6% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +6.4% -0.2% +6.6% +11.6% ➖ noise
33 duckdb:duckdb -1.6% -0.2% -1.5% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +30.3% -0.2% +30.5% +10.0% 🚨 regression
34 datafusion:vortex-file-compressed +3.5% +3.3% +0.2% +10.0% ➖ noise
34 duckdb:duckdb -1.7% +3.3% -4.8% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +32.6% +3.3% +28.3% +10.0% 🚨 regression
35 datafusion:vortex-file-compressed +3.6% +3.4% +0.2% +10.0% ➖ noise
35 duckdb:duckdb +0.9% +3.4% -2.4% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -1.0% +3.4% -4.3% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +2.9% +5.9% -2.8% +12.5% ➖ noise
36 duckdb:duckdb -6.9% +5.9% -12.1% +11.0% ✅ faster
36 duckdb:vortex-file-compressed +9.1% +5.9% +3.0% +10.5% ➖ noise
37 datafusion:vortex-file-compressed +8.3% +4.3% +3.9% +10.0% ➖ noise
37 duckdb:duckdb -10.1% +4.3% -13.8% +10.0% ✅ faster
37 duckdb:vortex-file-compressed +1.2% +4.3% -2.9% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +15.1% +1.5% +13.5% +10.0% 🚨 regression
38 duckdb:duckdb -7.9% +1.5% -9.2% +10.0% ✅ faster
38 duckdb:vortex-file-compressed +6.7% +1.5% +5.1% +10.0% ➖ noise
39 datafusion:vortex-file-compressed +10.1% +2.0% +7.9% +10.0% ➖ noise
39 duckdb:duckdb -6.9% +2.0% -8.7% +11.8% ➖ noise
39 duckdb:vortex-file-compressed +5.7% +2.0% +3.6% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +13.2% +5.0% +7.8% +10.0% ➖ noise
40 duckdb:duckdb -10.8% +5.0% -15.0% +10.0% ✅ faster
40 duckdb:vortex-file-compressed +7.9% +5.0% +2.8% +10.0% ➖ noise
41 datafusion:vortex-file-compressed +21.0% +5.4% +14.8% +10.0% 🚨 regression
41 duckdb:duckdb -9.0% +5.4% -13.7% +10.6% ✅ faster
41 duckdb:vortex-file-compressed +5.3% +5.4% -0.1% +12.1% ➖ noise
42 datafusion:vortex-file-compressed +11.7% +6.7% +4.6% +10.0% ➖ noise
42 duckdb:duckdb -11.3% +6.7% -16.9% +10.0% ✅ faster
42 duckdb:vortex-file-compressed -8.1% +6.7% -13.8% +10.0% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 15, 2026

File Sizes: Clickbench on NVME

File Size Changes (201 files changed, -33.4% overall, 60↑ 141↓)
File Scale Format Base HEAD Change %
hits_48.vortex 1.0 vortex-file-compressed 28.11 MB 29.94 MB +1.83 MB +6.5%
hits_41.vortex 1.0 vortex-file-compressed 297.76 MB 309.32 MB +11.56 MB +3.9%
hits_43.vortex 1.0 vortex-file-compressed 303.02 MB 314.63 MB +11.61 MB +3.8%
hits_42.vortex 1.0 vortex-file-compressed 296.11 MB 307.36 MB +11.26 MB +3.8%
hits_11.vortex 1.0 vortex-file-compressed 95.07 MB 98.26 MB +3.19 MB +3.4%
hits_39.vortex 1.0 vortex-file-compressed 92.67 MB 95.73 MB +3.06 MB +3.3%
hits_36.vortex 1.0 vortex-file-compressed 79.48 MB 82.08 MB +2.60 MB +3.3%
hits_29.vortex 1.0 vortex-file-compressed 64.72 MB 66.52 MB +1.81 MB +2.8%
hits_33.vortex 1.0 vortex-file-compressed 61.95 MB 63.66 MB +1.71 MB +2.8%
hits_44.vortex 1.0 vortex-file-compressed 241.45 MB 247.95 MB +6.50 MB +2.7%
hits_47.vortex 1.0 vortex-file-compressed 41.47 MB 42.57 MB +1.10 MB +2.6%
hits_18.vortex 1.0 vortex-file-compressed 125.20 MB 128.39 MB +3.19 MB +2.5%
hits_77.vortex 1.0 vortex-file-compressed 217.10 MB 222.39 MB +5.29 MB +2.4%
hits_20.vortex 1.0 vortex-file-compressed 66.58 MB 67.92 MB +1.34 MB +2.0%
hits_71.vortex 1.0 vortex-file-compressed 125.12 MB 127.45 MB +2.33 MB +1.9%
hits_30.vortex 1.0 vortex-file-compressed 102.83 MB 104.74 MB +1.91 MB +1.9%
hits_86.vortex 1.0 vortex-file-compressed 80.62 MB 82.10 MB +1.48 MB +1.8%
hits_88.vortex 1.0 vortex-file-compressed 135.89 MB 138.30 MB +2.41 MB +1.8%
hits_70.vortex 1.0 vortex-file-compressed 114.08 MB 116.04 MB +1.96 MB +1.7%
hits_12.vortex 1.0 vortex-file-compressed 124.07 MB 126.07 MB +2.01 MB +1.6%
hits_32.vortex 1.0 vortex-file-compressed 76.12 MB 77.24 MB +1.12 MB +1.5%
hits_35.vortex 1.0 vortex-file-compressed 137.56 MB 139.56 MB +2.00 MB +1.5%
hits_82.vortex 1.0 vortex-file-compressed 121.02 MB 122.63 MB +1.61 MB +1.3%
hits_8.vortex 1.0 vortex-file-compressed 121.89 MB 123.43 MB +1.54 MB +1.3%
hits_7.vortex 1.0 vortex-file-compressed 122.77 MB 124.26 MB +1.50 MB +1.2%
hits_55.vortex 1.0 vortex-file-compressed 250.46 MB 253.50 MB +3.04 MB +1.2%
hits_13.vortex 1.0 vortex-file-compressed 121.63 MB 123.02 MB +1.39 MB +1.1%
hits_6.vortex 1.0 vortex-file-compressed 121.89 MB 123.28 MB +1.39 MB +1.1%
hits_83.vortex 1.0 vortex-file-compressed 102.67 MB 103.81 MB +1.15 MB +1.1%
hits_56.vortex 1.0 vortex-file-compressed 162.66 MB 164.47 MB +1.81 MB +1.1%
hits_64.vortex 1.0 vortex-file-compressed 94.21 MB 95.25 MB +1.04 MB +1.1%
hits_5.vortex 1.0 vortex-file-compressed 121.66 MB 122.93 MB +1.28 MB +1.0%
hits_81.vortex 1.0 vortex-file-compressed 125.70 MB 127.01 MB +1.31 MB +1.0%
hits_10.vortex 1.0 vortex-file-compressed 81.05 MB 81.87 MB +841.39 KB +1.0%
hits_28.vortex 1.0 vortex-file-compressed 166.34 MB 167.93 MB +1.58 MB +1.0%
hits_38.vortex 1.0 vortex-file-compressed 117.06 MB 118.18 MB +1.11 MB +1.0%
hits_17.vortex 1.0 vortex-file-compressed 102.70 MB 103.66 MB +981.61 KB +0.9%
hits_0.vortex 1.0 vortex-file-compressed 111.46 MB 112.43 MB +991.35 KB +0.9%
hits_26.vortex 1.0 vortex-file-compressed 142.56 MB 143.78 MB +1.22 MB +0.9%
hits_68.vortex 1.0 vortex-file-compressed 171.22 MB 172.64 MB +1.42 MB +0.8%
hits_62.vortex 1.0 vortex-file-compressed 147.10 MB 148.27 MB +1.17 MB +0.8%
hits_75.vortex 1.0 vortex-file-compressed 73.40 MB 73.89 MB +505.53 KB +0.7%
hits_59.vortex 1.0 vortex-file-compressed 120.49 MB 121.21 MB +734.84 KB +0.6%
hits_27.vortex 1.0 vortex-file-compressed 173.50 MB 174.53 MB +1.03 MB +0.6%
hits_22.vortex 1.0 vortex-file-compressed 78.94 MB 79.39 MB +459.41 KB +0.6%
hits_93.vortex 1.0 vortex-file-compressed 106.43 MB 107.02 MB +610.05 KB +0.6%
hits_50.vortex 1.0 vortex-file-compressed 253.80 MB 255.16 MB +1.36 MB +0.5%
hits_53.vortex 1.0 vortex-file-compressed 96.77 MB 97.23 MB +477.16 KB +0.5%
hits_96.vortex 1.0 vortex-file-compressed 179.48 MB 180.32 MB +862.52 KB +0.5%
hits_23.vortex 1.0 vortex-file-compressed 78.38 MB 78.72 MB +352.41 KB +0.4%
hits_2.vortex 1.0 vortex-file-compressed 239.70 MB 240.70 MB +1.00 MB +0.4%
hits_37.vortex 1.0 vortex-file-compressed 96.35 MB 96.74 MB +401.01 KB +0.4%
hits_67.vortex 1.0 vortex-file-compressed 264.44 MB 265.34 MB +914.65 KB +0.3%
hits_54.vortex 1.0 vortex-file-compressed 360.62 MB 361.41 MB +807.86 KB +0.2%
hits_89.vortex 1.0 vortex-file-compressed 264.74 MB 265.08 MB +352.27 KB +0.1%
hits_4.vortex 1.0 vortex-file-compressed 137.68 MB 137.85 MB +169.87 KB +0.1%
hits_51.vortex 1.0 vortex-file-compressed 426.74 MB 427.25 MB +520.72 KB +0.1%
hits_79.vortex 1.0 vortex-file-compressed 202.78 MB 203.02 MB +245.38 KB +0.1%
hits_72.vortex 1.0 vortex-file-compressed 94.88 MB 94.97 MB +98.09 KB +0.1%
hits_24.vortex 1.0 vortex-file-compressed 77.97 MB 77.97 MB +3.91 KB +0.0%
hits_94.vortex 1.0 vortex-file-compressed 183.76 MB 183.68 MB 84.08 KB -0.0%
hits_91.vortex 1.0 vortex-file-compressed 115.26 MB 115.17 MB 92.92 KB -0.1%
hits_90.vortex 1.0 vortex-file-compressed 202.76 MB 202.52 MB 248.30 KB -0.1%
hits_95.vortex 1.0 vortex-file-compressed 113.14 MB 112.98 MB 164.31 KB -0.1%
hits_87.vortex 1.0 vortex-file-compressed 219.62 MB 218.93 MB 706.26 KB -0.3%
hits_78.vortex 1.0 vortex-file-compressed 237.45 MB 236.69 MB 779.62 KB -0.3%
hits_65.vortex 1.0 vortex-file-compressed 236.04 MB 235.13 MB 937.80 KB -0.4%
hits_63.vortex 1.0 vortex-file-compressed 79.72 MB 79.40 MB 326.05 KB -0.4%
hits_46.vortex 1.0 vortex-file-compressed 79.26 MB 78.91 MB 354.43 KB -0.4%
hits_3.vortex 1.0 vortex-file-compressed 191.80 MB 190.85 MB 974.13 KB -0.5%
hits_99.vortex 1.0 vortex-file-compressed 157.59 MB 156.77 MB 834.90 KB -0.5%
hits_1.vortex 1.0 vortex-file-compressed 180.21 MB 179.17 MB 1.04 MB -0.6%
hits_31.vortex 1.0 vortex-file-compressed 103.21 MB 102.61 MB 615.09 KB -0.6%
hits_66.vortex 1.0 vortex-file-compressed 104.02 MB 103.37 MB 660.73 KB -0.6%
hits_19.vortex 1.0 vortex-file-compressed 81.13 MB 80.61 MB 533.09 KB -0.6%
hits_92.vortex 1.0 vortex-file-compressed 195.24 MB 193.94 MB 1.30 MB -0.7%
hits_85.vortex 1.0 vortex-file-compressed 105.07 MB 104.34 MB 747.72 KB -0.7%
hits_21.vortex 1.0 vortex-file-compressed 99.70 MB 98.90 MB 813.34 KB -0.8%
hits_74.vortex 1.0 vortex-file-compressed 150.52 MB 149.24 MB 1.28 MB -0.9%
hits_57.vortex 1.0 vortex-file-compressed 156.87 MB 155.43 MB 1.43 MB -0.9%
hits_25.vortex 1.0 vortex-file-compressed 135.54 MB 134.15 MB 1.39 MB -1.0%
hits_98.vortex 1.0 vortex-file-compressed 149.39 MB 147.85 MB 1.54 MB -1.0%
hits_49.vortex 1.0 vortex-file-compressed 87.66 MB 86.74 MB 945.98 KB -1.1%
hits_58.vortex 1.0 vortex-file-compressed 113.02 MB 111.80 MB 1.22 MB -1.1%
hits_52.vortex 1.0 vortex-file-compressed 119.21 MB 117.75 MB 1.46 MB -1.2%
hits_14.vortex 1.0 vortex-file-compressed 133.90 MB 132.22 MB 1.68 MB -1.3%
hits_76.vortex 1.0 vortex-file-compressed 138.22 MB 136.37 MB 1.85 MB -1.3%
hits_15.vortex 1.0 vortex-file-compressed 95.39 MB 93.97 MB 1.42 MB -1.5%
hits_61.vortex 1.0 vortex-file-compressed 112.74 MB 111.01 MB 1.72 MB -1.5%
hits_97.vortex 1.0 vortex-file-compressed 129.62 MB 127.26 MB 2.36 MB -1.8%
hits_73.vortex 1.0 vortex-file-compressed 130.48 MB 127.98 MB 2.50 MB -1.9%
hits_84.vortex 1.0 vortex-file-compressed 143.42 MB 140.54 MB 2.88 MB -2.0%
hits_40.vortex 1.0 vortex-file-compressed 141.59 MB 138.48 MB 3.10 MB -2.2%
hits_9.vortex 1.0 vortex-file-compressed 123.24 MB 120.30 MB 2.94 MB -2.4%
hits_60.vortex 1.0 vortex-file-compressed 120.45 MB 117.37 MB 3.08 MB -2.6%
hits_69.vortex 1.0 vortex-file-compressed 145.96 MB 142.00 MB 3.96 MB -2.7%
hits_45.vortex 1.0 vortex-file-compressed 143.54 MB 139.21 MB 4.33 MB -3.0%
hits_80.vortex 1.0 vortex-file-compressed 122.75 MB 118.91 MB 3.83 MB -3.1%
hits_16.vortex 1.0 vortex-file-compressed 86.38 MB 83.17 MB 3.21 MB -3.7%
hits_34.vortex 1.0 vortex-file-compressed 110.35 MB 105.95 MB 4.40 MB -4.0%
hits_12.vortex 1.0 vortex-compact 69.04 MB 0 B 69.04 MB -100.0%
hits_1.vortex 1.0 vortex-compact 90.07 MB 0 B 90.07 MB -100.0%
hits_64.vortex 1.0 vortex-compact 53.69 MB 0 B 53.69 MB -100.0%
hits_96.vortex 1.0 vortex-compact 90.83 MB 0 B 90.83 MB -100.0%
hits_83.vortex 1.0 vortex-compact 52.30 MB 0 B 52.30 MB -100.0%
hits_89.vortex 1.0 vortex-compact 112.45 MB 0 B 112.45 MB -100.0%
hits_21.vortex 1.0 vortex-compact 51.31 MB 0 B 51.31 MB -100.0%
hits_99.vortex 1.0 vortex-compact 77.04 MB 0 B 77.04 MB -100.0%
hits_76.vortex 1.0 vortex-compact 76.12 MB 0 B 76.12 MB -100.0%
hits_14.vortex 1.0 vortex-compact 73.52 MB 0 B 73.52 MB -100.0%
hits_87.vortex 1.0 vortex-compact 118.73 MB 0 B 118.73 MB -100.0%
hits_44.vortex 1.0 vortex-compact 132.13 MB 0 B 132.13 MB -100.0%
hits_10.vortex 1.0 vortex-compact 48.67 MB 0 B 48.67 MB -100.0%
hits_32.vortex 1.0 vortex-compact 43.89 MB 0 B 43.89 MB -100.0%
hits_8.vortex 1.0 vortex-compact 62.67 MB 0 B 62.67 MB -100.0%
hits_29.vortex 1.0 vortex-compact 36.38 MB 0 B 36.38 MB -100.0%
hits_19.vortex 1.0 vortex-compact 44.56 MB 0 B 44.56 MB -100.0%
hits_30.vortex 1.0 vortex-compact 58.46 MB 0 B 58.46 MB -100.0%
hits_20.vortex 1.0 vortex-compact 37.88 MB 0 B 37.88 MB -100.0%
hits_38.vortex 1.0 vortex-compact 62.85 MB 0 B 62.85 MB -100.0%
hits_46.vortex 1.0 vortex-compact 41.67 MB 0 B 41.67 MB -100.0%
hits_56.vortex 1.0 vortex-compact 77.69 MB 0 B 77.69 MB -100.0%
hits_41.vortex 1.0 vortex-compact 165.44 MB 0 B 165.44 MB -100.0%
hits_4.vortex 1.0 vortex-compact 71.55 MB 0 B 71.55 MB -100.0%
hits_6.vortex 1.0 vortex-compact 62.94 MB 0 B 62.94 MB -100.0%
hits_52.vortex 1.0 vortex-compact 63.44 MB 0 B 63.44 MB -100.0%
hits_60.vortex 1.0 vortex-compact 64.06 MB 0 B 64.06 MB -100.0%
hits_2.vortex 1.0 vortex-compact 129.05 MB 0 B 129.05 MB -100.0%
hits_67.vortex 1.0 vortex-compact 113.75 MB 0 B 113.75 MB -100.0%
hits_39.vortex 1.0 vortex-compact 49.56 MB 0 B 49.56 MB -100.0%
hits_27.vortex 1.0 vortex-compact 69.68 MB 0 B 69.68 MB -100.0%
hits_35.vortex 1.0 vortex-compact 74.79 MB 0 B 74.79 MB -100.0%
hits_86.vortex 1.0 vortex-compact 48.01 MB 0 B 48.01 MB -100.0%
hits_3.vortex 1.0 vortex-compact 93.91 MB 0 B 93.91 MB -100.0%
hits_34.vortex 1.0 vortex-compact 58.01 MB 0 B 58.01 MB -100.0%
hits_69.vortex 1.0 vortex-compact 80.76 MB 0 B 80.76 MB -100.0%
hits_81.vortex 1.0 vortex-compact 65.21 MB 0 B 65.21 MB -100.0%
hits_71.vortex 1.0 vortex-compact 69.03 MB 0 B 69.03 MB -100.0%
hits_43.vortex 1.0 vortex-compact 168.57 MB 0 B 168.57 MB -100.0%
hits_68.vortex 1.0 vortex-compact 75.68 MB 0 B 75.68 MB -100.0%
hits_59.vortex 1.0 vortex-compact 65.96 MB 0 B 65.96 MB -100.0%
hits_61.vortex 1.0 vortex-compact 57.40 MB 0 B 57.40 MB -100.0%
hits_57.vortex 1.0 vortex-compact 83.30 MB 0 B 83.30 MB -100.0%
hits_70.vortex 1.0 vortex-compact 61.06 MB 0 B 61.06 MB -100.0%
hits_63.vortex 1.0 vortex-compact 45.88 MB 0 B 45.88 MB -100.0%
hits_33.vortex 1.0 vortex-compact 35.72 MB 0 B 35.72 MB -100.0%
hits_80.vortex 1.0 vortex-compact 67.81 MB 0 B 67.81 MB -100.0%
hits_16.vortex 1.0 vortex-compact 48.10 MB 0 B 48.10 MB -100.0%
hits_37.vortex 1.0 vortex-compact 53.61 MB 0 B 53.61 MB -100.0%
hits_15.vortex 1.0 vortex-compact 47.88 MB 0 B 47.88 MB -100.0%
hits_97.vortex 1.0 vortex-compact 68.91 MB 0 B 68.91 MB -100.0%
hits_98.vortex 1.0 vortex-compact 72.46 MB 0 B 72.46 MB -100.0%
hits_7.vortex 1.0 vortex-compact 63.58 MB 0 B 63.58 MB -100.0%
hits_88.vortex 1.0 vortex-compact 73.07 MB 0 B 73.07 MB -100.0%
hits_47.vortex 1.0 vortex-compact 18.06 MB 0 B 18.06 MB -100.0%
hits_65.vortex 1.0 vortex-compact 129.63 MB 0 B 129.63 MB -100.0%
hits_66.vortex 1.0 vortex-compact 53.26 MB 0 B 53.26 MB -100.0%
hits_28.vortex 1.0 vortex-compact 70.05 MB 0 B 70.05 MB -100.0%
hits_72.vortex 1.0 vortex-compact 51.54 MB 0 B 51.54 MB -100.0%
hits_82.vortex 1.0 vortex-compact 66.59 MB 0 B 66.59 MB -100.0%
hits_85.vortex 1.0 vortex-compact 52.51 MB 0 B 52.51 MB -100.0%
hits_75.vortex 1.0 vortex-compact 43.41 MB 0 B 43.41 MB -100.0%
hits_23.vortex 1.0 vortex-compact 43.94 MB 0 B 43.94 MB -100.0%
hits_49.vortex 1.0 vortex-compact 50.27 MB 0 B 50.27 MB -100.0%
hits_58.vortex 1.0 vortex-compact 60.19 MB 0 B 60.19 MB -100.0%
hits_42.vortex 1.0 vortex-compact 163.89 MB 0 B 163.89 MB -100.0%
hits_11.vortex 1.0 vortex-compact 54.10 MB 0 B 54.10 MB -100.0%
hits_24.vortex 1.0 vortex-compact 43.39 MB 0 B 43.39 MB -100.0%
hits_95.vortex 1.0 vortex-compact 57.47 MB 0 B 57.47 MB -100.0%
hits_91.vortex 1.0 vortex-compact 60.68 MB 0 B 60.68 MB -100.0%
hits_0.vortex 1.0 vortex-compact 58.39 MB 0 B 58.39 MB -100.0%
hits_25.vortex 1.0 vortex-compact 72.87 MB 0 B 72.87 MB -100.0%
hits_73.vortex 1.0 vortex-compact 69.77 MB 0 B 69.77 MB -100.0%
hits_94.vortex 1.0 vortex-compact 90.36 MB 0 B 90.36 MB -100.0%
hits_31.vortex 1.0 vortex-compact 55.28 MB 0 B 55.28 MB -100.0%
hits_50.vortex 1.0 vortex-compact 112.75 MB 0 B 112.75 MB -100.0%
hits_22.vortex 1.0 vortex-compact 44.48 MB 0 B 44.48 MB -100.0%
hits_36.vortex 1.0 vortex-compact 48.75 MB 0 B 48.75 MB -100.0%
hits_79.vortex 1.0 vortex-compact 85.36 MB 0 B 85.36 MB -100.0%
hits_18.vortex 1.0 vortex-compact 64.03 MB 0 B 64.03 MB -100.0%
hits_13.vortex 1.0 vortex-compact 67.72 MB 0 B 67.72 MB -100.0%
hits_48.vortex 1.0 vortex-compact 17.12 MB 0 B 17.12 MB -100.0%
hits_17.vortex 1.0 vortex-compact 58.08 MB 0 B 58.08 MB -100.0%
hits_40.vortex 1.0 vortex-compact 75.65 MB 0 B 75.65 MB -100.0%
hits_51.vortex 1.0 vortex-compact 167.28 MB 0 B 167.28 MB -100.0%
hits_74.vortex 1.0 vortex-compact 71.37 MB 0 B 71.37 MB -100.0%
hits_9.vortex 1.0 vortex-compact 65.45 MB 0 B 65.45 MB -100.0%
hits_53.vortex 1.0 vortex-compact 58.85 MB 0 B 58.85 MB -100.0%
hits_62.vortex 1.0 vortex-compact 74.04 MB 0 B 74.04 MB -100.0%
hits_26.vortex 1.0 vortex-compact 70.65 MB 0 B 70.65 MB -100.0%
hits_5.vortex 1.0 vortex-compact 62.68 MB 0 B 62.68 MB -100.0%
hits_92.vortex 1.0 vortex-compact 94.00 MB 0 B 94.00 MB -100.0%
hits_55.vortex 1.0 vortex-compact 93.45 MB 0 B 93.45 MB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_90.vortex 1.0 vortex-compact 81.59 MB 0 B 81.59 MB -100.0%
hits_78.vortex 1.0 vortex-compact 97.53 MB 0 B 97.53 MB -100.0%
hits_54.vortex 1.0 vortex-compact 117.25 MB 0 B 117.25 MB -100.0%
hits_84.vortex 1.0 vortex-compact 72.85 MB 0 B 72.85 MB -100.0%
hits_93.vortex 1.0 vortex-compact 58.65 MB 0 B 58.65 MB -100.0%
hits_45.vortex 1.0 vortex-compact 75.70 MB 0 B 75.70 MB -100.0%
hits_77.vortex 1.0 vortex-compact 117.87 MB 0 B 117.87 MB -100.0%

Totals:

  • vortex-compact: 7.03 GB → 0 B (-100.0%)
  • vortex-file-compressed: 13.88 GB → 13.94 GB (+0.4%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 15, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +13.7%
Vortex (geomean): 1.179x ➖
Parquet (geomean): 1.036x ➖
Shifts: Parquet (control) +3.6% · Median polish +10.8%

datafusion / vortex-file-compressed (1.272x ➖, 1↑ 7↓)
name PR 39d4ffa (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 261487138 199597542 1.31
tpch_q02/datafusion:vortex-file-compressed 485650438 444769819 1.09
tpch_q03/datafusion:vortex-file-compressed 403916990 343484176 1.18
tpch_q04/datafusion:vortex-file-compressed 🚨 237338394 181976994 1.30
tpch_q05/datafusion:vortex-file-compressed 421470430 378220489 1.11
tpch_q06/datafusion:vortex-file-compressed 🚨 349327685 266223568 1.31
tpch_q07/datafusion:vortex-file-compressed 404124106 349955866 1.15
tpch_q08/datafusion:vortex-file-compressed 553551329 554274771 1.00
tpch_q09/datafusion:vortex-file-compressed 390949115 354997801 1.10
tpch_q10/datafusion:vortex-file-compressed 505595983 431260601 1.17
tpch_q11/datafusion:vortex-file-compressed 314050296 312227182 1.01
tpch_q12/datafusion:vortex-file-compressed 🚨 1491196068 354021323 4.21
tpch_q13/datafusion:vortex-file-compressed 🚨 457200515 156358784 2.92
tpch_q14/datafusion:vortex-file-compressed 🚨 711224656 261219876 2.72
tpch_q15/datafusion:vortex-file-compressed 510396463 454906807 1.12
tpch_q16/datafusion:vortex-file-compressed 🚀 213786463 365868625 0.58
tpch_q17/datafusion:vortex-file-compressed 359881429 409285463 0.88
tpch_q18/datafusion:vortex-file-compressed 386529202 339267584 1.14
tpch_q19/datafusion:vortex-file-compressed 445811261 439836570 1.01
tpch_q20/datafusion:vortex-file-compressed 463706759 382468202 1.21
tpch_q21/datafusion:vortex-file-compressed 🚨 627839965 470750523 1.33
tpch_q22/datafusion:vortex-file-compressed 184135503 159290368 1.16
datafusion / vortex-compact (1.060x ➖, 1↑ 2↓)
name PR 39d4ffa (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 249002709 232639589 1.07
tpch_q02/datafusion:vortex-compact 426223202 414116105 1.03
tpch_q03/datafusion:vortex-compact 466269730 399996754 1.17
tpch_q04/datafusion:vortex-compact 328952736 272135171 1.21
tpch_q05/datafusion:vortex-compact 476342693 397110492 1.20
tpch_q06/datafusion:vortex-compact 360549267 328264255 1.10
tpch_q07/datafusion:vortex-compact 389570829 450551164 0.86
tpch_q08/datafusion:vortex-compact 510406870 588125624 0.87
tpch_q09/datafusion:vortex-compact 448660314 476637149 0.94
tpch_q10/datafusion:vortex-compact 512881037 483515370 1.06
tpch_q11/datafusion:vortex-compact 289776462 281143827 1.03
tpch_q12/datafusion:vortex-compact 🚨 571837142 403100115 1.42
tpch_q13/datafusion:vortex-compact 154442679 157376548 0.98
tpch_q14/datafusion:vortex-compact 289254715 291957083 0.99
tpch_q15/datafusion:vortex-compact 560606255 523448142 1.07
tpch_q16/datafusion:vortex-compact 202300461 187391450 1.08
tpch_q17/datafusion:vortex-compact 380561698 347710610 1.09
tpch_q18/datafusion:vortex-compact 🚨 507682443 286383154 1.77
tpch_q19/datafusion:vortex-compact 426383977 443510966 0.96
tpch_q20/datafusion:vortex-compact 449248760 426679273 1.05
tpch_q21/datafusion:vortex-compact 569251382 507319610 1.12
tpch_q22/datafusion:vortex-compact 🚀 155890224 241886345 0.64
datafusion / parquet (1.027x ➖, 0↑ 2↓)
name PR 39d4ffa (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 223513133 252175272 0.89
tpch_q02/datafusion:parquet 🚨 660934578 437846786 1.51
tpch_q03/datafusion:parquet 🚨 485135800 305676976 1.59
tpch_q04/datafusion:parquet 198368538 153496288 1.29
tpch_q05/datafusion:parquet 485766102 508167032 0.96
tpch_q06/datafusion:parquet 158156113 138306373 1.14
tpch_q07/datafusion:parquet 478011061 520838073 0.92
tpch_q08/datafusion:parquet 592954547 601079926 0.99
tpch_q09/datafusion:parquet 515424939 509992617 1.01
tpch_q10/datafusion:parquet 495823248 501018236 0.99
tpch_q11/datafusion:parquet 344356525 378930583 0.91
tpch_q12/datafusion:parquet 222626957 257373388 0.86
tpch_q13/datafusion:parquet 433627218 448491547 0.97
tpch_q14/datafusion:parquet 176905102 189799964 0.93
tpch_q15/datafusion:parquet 295116700 291725236 1.01
tpch_q16/datafusion:parquet 172138206 175860352 0.98
tpch_q17/datafusion:parquet 365824468 400965258 0.91
tpch_q18/datafusion:parquet 434631236 439237319 0.99
tpch_q19/datafusion:parquet 334737647 404872787 0.83
tpch_q20/datafusion:parquet 406013194 363439453 1.12
tpch_q21/datafusion:parquet 566621834 611483644 0.93
tpch_q22/datafusion:parquet 135503835 110583348 1.23
duckdb / vortex-file-compressed (1.211x ➖, 0↑ 4↓)
name PR 39d4ffa (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 392476757 278633860 1.41
tpch_q02/duckdb:vortex-file-compressed 1020545649 948661244 1.08
tpch_q03/duckdb:vortex-file-compressed 785600452 622491005 1.26
tpch_q04/duckdb:vortex-file-compressed 448701526 356537799 1.26
tpch_q05/duckdb:vortex-file-compressed 1031086650 873697175 1.18
tpch_q06/duckdb:vortex-file-compressed 🚨 754744181 427121580 1.77
tpch_q07/duckdb:vortex-file-compressed 861015745 721914143 1.19
tpch_q08/duckdb:vortex-file-compressed 1091155699 868684763 1.26
tpch_q09/duckdb:vortex-file-compressed 1052852993 877603160 1.20
tpch_q10/duckdb:vortex-file-compressed 🚨 932811771 660277564 1.41
tpch_q11/duckdb:vortex-file-compressed 462794624 503469509 0.92
tpch_q12/duckdb:vortex-file-compressed 556686882 467737938 1.19
tpch_q13/duckdb:vortex-file-compressed 486997903 474067120 1.03
tpch_q14/duckdb:vortex-file-compressed 🚨 719516520 461528099 1.56
tpch_q15/duckdb:vortex-file-compressed 388912093 305599934 1.27
tpch_q16/duckdb:vortex-file-compressed 397358170 371565728 1.07
tpch_q17/duckdb:vortex-file-compressed 752114347 650294612 1.16
tpch_q18/duckdb:vortex-file-compressed 633125970 548451497 1.15
tpch_q19/duckdb:vortex-file-compressed 539711872 474143805 1.14
tpch_q20/duckdb:vortex-file-compressed 884058925 795430320 1.11
tpch_q21/duckdb:vortex-file-compressed 1348850017 1049416163 1.29
tpch_q22/duckdb:vortex-file-compressed 359068295 352848910 1.02
duckdb / vortex-compact (1.182x ➖, 0↑ 5↓)
name PR 39d4ffa (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 345635749 295269576 1.17
tpch_q02/duckdb:vortex-compact 948772819 922102037 1.03
tpch_q03/duckdb:vortex-compact 671430617 571974570 1.17
tpch_q04/duckdb:vortex-compact 360701161 374965521 0.96
tpch_q05/duckdb:vortex-compact 🚨 1070709787 809393860 1.32
tpch_q06/duckdb:vortex-compact 🚨 859486136 401399185 2.14
tpch_q07/duckdb:vortex-compact 🚨 900283270 681390093 1.32
tpch_q08/duckdb:vortex-compact 936627388 914789162 1.02
tpch_q09/duckdb:vortex-compact 888765877 888617204 1.00
tpch_q10/duckdb:vortex-compact 🚨 972187608 706815743 1.38
tpch_q11/duckdb:vortex-compact 508331266 502057579 1.01
tpch_q12/duckdb:vortex-compact 505426962 478209354 1.06
tpch_q13/duckdb:vortex-compact 440722206 449154760 0.98
tpch_q14/duckdb:vortex-compact 🚨 723942923 422981252 1.71
tpch_q15/duckdb:vortex-compact 310926564 307006736 1.01
tpch_q16/duckdb:vortex-compact 404707492 378809498 1.07
tpch_q17/duckdb:vortex-compact 743466683 599741059 1.24
tpch_q18/duckdb:vortex-compact 603885209 514818303 1.17
tpch_q19/duckdb:vortex-compact 564610322 470323531 1.20
tpch_q20/duckdb:vortex-compact 823564713 765260963 1.08
tpch_q21/duckdb:vortex-compact 1257383030 977115025 1.29
tpch_q22/duckdb:vortex-compact 402758286 345297692 1.17
duckdb / parquet (1.045x ➖, 0↑ 0↓)
name PR 39d4ffa (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 528555306 513748905 1.03
tpch_q02/duckdb:parquet 1348236715 1350152185 1.00
tpch_q03/duckdb:parquet 1109977941 986626896 1.13
tpch_q04/duckdb:parquet 706141326 638279639 1.11
tpch_q05/duckdb:parquet 1671000648 1544773961 1.08
tpch_q06/duckdb:parquet 398326843 447987053 0.89
tpch_q07/duckdb:parquet 1285101652 1212898738 1.06
tpch_q08/duckdb:parquet 1690040355 1728961128 0.98
tpch_q09/duckdb:parquet 1504843678 1421283544 1.06
tpch_q10/duckdb:parquet 1451597448 1359940875 1.07
tpch_q11/duckdb:parquet 835538888 830118096 1.01
tpch_q12/duckdb:parquet 621349441 587565114 1.06
tpch_q13/duckdb:parquet 912722338 860818692 1.06
tpch_q14/duckdb:parquet 746270177 718895169 1.04
tpch_q15/duckdb:parquet 606547516 523665616 1.16
tpch_q16/duckdb:parquet 527675925 551561755 0.96
tpch_q17/duckdb:parquet 780316405 772251314 1.01
tpch_q18/duckdb:parquet 915487280 842768531 1.09
tpch_q19/duckdb:parquet 848565265 821757651 1.03
tpch_q20/duckdb:parquet 1077181645 1089257368 0.99
tpch_q21/duckdb:parquet 1254003380 1177744123 1.06
tpch_q22/duckdb:parquet 559623300 473785401 1.18
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +7.0% -4.5% +12.1% +73.9% ➖ noise
1 datafusion:vortex-file-compressed +31.0% -4.5% +37.2% +63.3% ➖ noise
1 duckdb:vortex-compact +17.1% -4.5% +22.6% +47.8% ➖ noise
1 duckdb:vortex-file-compressed +40.9% -4.5% +47.5% +40.4% 🚨 regression
2 datafusion:vortex-compact +2.9% +22.8% -16.2% +30.4% ➖ noise
2 datafusion:vortex-file-compressed +9.2% +22.8% -11.1% +32.4% ➖ noise
2 duckdb:vortex-compact +2.9% +22.8% -16.2% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +7.6% +22.8% -12.4% +30.0% ➖ noise
3 datafusion:vortex-compact +16.6% +33.6% -12.8% +52.8% ➖ noise
3 datafusion:vortex-file-compressed +17.6% +33.6% -12.0% +51.8% ➖ noise
3 duckdb:vortex-compact +17.4% +33.6% -12.1% +31.5% ➖ noise
3 duckdb:vortex-file-compressed +26.2% +33.6% -5.6% +30.0% ➖ noise
4 datafusion:vortex-compact +20.9% +19.6% +1.1% +31.4% ➖ noise
4 datafusion:vortex-file-compressed +30.4% +19.6% +9.1% +30.0% ➖ noise
4 duckdb:vortex-compact -3.8% +19.6% -19.5% +37.9% ➖ noise
4 duckdb:vortex-file-compressed +25.8% +19.6% +5.3% +30.0% ➖ noise
5 datafusion:vortex-compact +20.0% +1.7% +18.0% +37.9% ➖ noise
5 datafusion:vortex-file-compressed +11.4% +1.7% +9.6% +30.0% ➖ noise
5 duckdb:vortex-compact +32.3% +1.7% +30.1% +30.0% 🚨 regression
5 duckdb:vortex-file-compressed +18.0% +1.7% +16.1% +30.0% ➖ noise
6 datafusion:vortex-compact +9.8% +0.8% +8.9% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +31.2% +0.8% +30.1% +30.0% 🚨 regression
6 duckdb:vortex-compact +114.1% +0.8% +112.4% +30.0% 🚨 regression
6 duckdb:vortex-file-compressed +76.7% +0.8% +75.2% +30.0% 🚨 regression
7 datafusion:vortex-compact -13.5% -1.4% -12.3% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +15.5% -1.4% +17.1% +30.0% ➖ noise
7 duckdb:vortex-compact +32.1% -1.4% +34.0% +30.0% 🚨 regression
7 duckdb:vortex-file-compressed +19.3% -1.4% +20.9% +30.0% ➖ noise
8 datafusion:vortex-compact -13.2% -1.8% -11.6% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -0.1% -1.8% +1.7% +30.0% ➖ noise
8 duckdb:vortex-compact +2.4% -1.8% +4.3% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +25.6% -1.8% +27.9% +30.0% ➖ noise
9 datafusion:vortex-compact -5.9% +3.4% -9.0% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +10.1% +3.4% +6.5% +30.0% ➖ noise
9 duckdb:vortex-compact +0.0% +3.4% -3.3% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +20.0% +3.4% +16.0% +30.0% ➖ noise
10 datafusion:vortex-compact +6.1% +2.8% +3.2% +30.0% ➖ noise
10 datafusion:vortex-file-compressed +17.2% +2.8% +14.1% +30.0% ➖ noise
10 duckdb:vortex-compact +37.5% +2.8% +33.8% +30.0% 🚨 regression
10 duckdb:vortex-file-compressed +41.3% +2.8% +37.5% +30.0% 🚨 regression
11 datafusion:vortex-compact +3.1% -4.4% +7.8% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +0.6% -4.4% +5.2% +30.0% ➖ noise
11 duckdb:vortex-compact +1.2% -4.4% +5.9% +66.5% ➖ noise
11 duckdb:vortex-file-compressed -8.1% -4.4% -3.9% +30.0% ➖ noise
12 datafusion:vortex-compact +41.9% -4.4% +48.3% +31.5% 🚨 regression
12 datafusion:vortex-file-compressed +321.2% -4.4% +340.4% +76.3% 🚨 regression
12 duckdb:vortex-compact +5.7% -4.4% +10.5% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +19.0% -4.4% +24.4% +30.0% ➖ noise
13 datafusion:vortex-compact -1.9% +1.2% -3.1% +52.7% ➖ noise
13 datafusion:vortex-file-compressed +192.4% +1.2% +188.8% +72.5% 🚨 regression
13 duckdb:vortex-compact -1.9% +1.2% -3.1% +33.3% ➖ noise
13 duckdb:vortex-file-compressed +2.7% +1.2% +1.5% +34.6% ➖ noise
14 datafusion:vortex-compact -0.9% -1.6% +0.7% +33.6% ➖ noise
14 datafusion:vortex-file-compressed +172.3% -1.6% +176.8% +71.4% 🚨 regression
14 duckdb:vortex-compact +71.2% -1.6% +74.0% +39.4% 🚨 regression
14 duckdb:vortex-file-compressed +55.9% -1.6% +58.5% +30.0% 🚨 regression
15 datafusion:vortex-compact +7.1% +8.2% -1.1% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +12.2% +8.2% +3.7% +30.0% ➖ noise
15 duckdb:vortex-compact +1.3% +8.2% -6.4% +31.6% ➖ noise
15 duckdb:vortex-file-compressed +27.3% +8.2% +17.6% +30.0% ➖ noise
16 datafusion:vortex-compact +8.0% -3.2% +11.6% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -41.6% -3.2% -39.6% +30.0% ✅ faster
16 duckdb:vortex-compact +6.8% -3.2% +10.4% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +6.9% -3.2% +10.5% +30.0% ➖ noise
17 datafusion:vortex-compact +9.4% -4.0% +14.0% +36.1% ➖ noise
17 datafusion:vortex-file-compressed -12.1% -4.0% -8.4% +42.5% ➖ noise
17 duckdb:vortex-compact +24.0% -4.0% +29.1% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +15.7% -4.0% +20.5% +30.0% ➖ noise
18 datafusion:vortex-compact +77.3% +3.7% +71.0% +30.0% 🚨 regression
18 datafusion:vortex-file-compressed +13.9% +3.7% +9.9% +44.1% ➖ noise
18 duckdb:vortex-compact +17.3% +3.7% +13.1% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +15.4% +3.7% +11.3% +30.0% ➖ noise
19 datafusion:vortex-compact -3.9% -7.6% +4.0% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +1.4% -7.6% +9.7% +30.0% ➖ noise
19 duckdb:vortex-compact +20.0% -7.6% +29.9% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +13.8% -7.6% +23.2% +30.0% ➖ noise
20 datafusion:vortex-compact +5.3% +5.1% +0.2% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +21.2% +5.1% +15.3% +30.0% ➖ noise
20 duckdb:vortex-compact +7.6% +5.1% +2.4% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +11.1% +5.1% +5.7% +30.0% ➖ noise
21 datafusion:vortex-compact +12.2% -0.7% +13.0% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +33.4% -0.7% +34.3% +30.0% 🚨 regression
21 duckdb:vortex-compact +28.7% -0.7% +29.6% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +28.5% -0.7% +29.4% +30.0% ➖ noise
22 datafusion:vortex-compact -35.6% +20.3% -46.4% +30.0% ✅ faster
22 datafusion:vortex-file-compressed +15.6% +20.3% -3.9% +39.3% ➖ noise
22 duckdb:vortex-compact +16.6% +20.3% -3.0% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +1.8% +20.3% -15.4% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 15, 2026

Benchmarks: Compression

Vortex (geomean): 1.104x ❌
Parquet (geomean): 1.059x ➖

unknown / unknown (1.079x ➖, 0↑ 29↓)
name PR 39d4ffa (ns) base 9406303 (ns) ratio (PR/base)
compress time/Arade 🚨 1396018688 1197117783 1.17
compress time/Bimbo 7721453173 7218317130 1.07
compress time/CMSprovider 🚨 3354366496 2932866407 1.14
compress time/Euro2016 🚨 483820755 439032264 1.10
compress time/Food 🚨 447652685 400030646 1.12
compress time/HashTags 🚨 1102801843 819920738 1.35
compress time/TPC-H l_comment canonical 1418814234 1308998380 1.08
compress time/TPC-H l_comment chunked 1431022509 1321040374 1.08
compress time/taxi 🚨 1041378138 718859501 1.45
compress time/wide table cols=100 chunks=1 rows=1000 13818963 12745622 1.08
compress time/wide table cols=100 chunks=50 rows=1000 13746325 13030780 1.05
compress time/wide table cols=1000 chunks=1 rows=1000 138036544 135108934 1.02
compress time/wide table cols=1000 chunks=50 rows=1000 138803691 138506820 1.00
compress time/wide table cols=10000 chunks=1 rows=1000 1416261036 1415166601 1.00
compress time/wide table cols=10000 chunks=50 rows=1000 1420809297 1435480583 0.99
decompress time/Arade 🚨 52198613 32587493 1.60
decompress time/Bimbo 🚨 321972656 106095694 3.03
decompress time/CMSprovider 🚨 133694043 85641756 1.56
decompress time/Euro2016 22547055 20609398 1.09
decompress time/Food 🚨 16136696 9564160 1.69
decompress time/HashTags 82293303 80003548 1.03
decompress time/TPC-H l_comment canonical 🚨 49127676 41536986 1.18
decompress time/TPC-H l_comment chunked 🚨 49841795 42570529 1.17
decompress time/taxi 🚨 36653131 22357859 1.64
decompress time/wide table cols=100 chunks=1 rows=1000 2787613 2972470 0.94
decompress time/wide table cols=100 chunks=50 rows=1000 2758679 2927522 0.94
decompress time/wide table cols=1000 chunks=1 rows=1000 24805854 24474266 1.01
decompress time/wide table cols=1000 chunks=50 rows=1000 24781746 25176171 0.98
decompress time/wide table cols=10000 chunks=1 rows=1000 250897403 261147276 0.96
decompress time/wide table cols=10000 chunks=50 rows=1000 259845147 261592725 0.99
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 3016779739 3048851605 0.99
parquet_rs-zstd compress time/Bimbo 17341155959 17197471784 1.01
parquet_rs-zstd compress time/CMSprovider 7721942469 7827557918 0.99
parquet_rs-zstd compress time/Euro2016 1343980487 1348863098 1.00
parquet_rs-zstd compress time/Food 936044900 928351545 1.01
parquet_rs-zstd compress time/HashTags 2494234242 2509327225 0.99
parquet_rs-zstd compress time/TPC-H l_comment canonical 3107881480 3132527869 0.99
parquet_rs-zstd compress time/TPC-H l_comment chunked 3083101168 3108641766 0.99
parquet_rs-zstd compress time/taxi 1521592214 1531271638 0.99
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6620114 6738752 0.98
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6755154 6880694 0.98
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 84436330 92607466 0.91
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 85252623 89613134 0.95
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 866815639 890197768 0.97
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 869617243 913826947 0.95
parquet_rs-zstd decompress time/Arade 646944572 655183891 0.99
parquet_rs-zstd decompress time/Bimbo 1733312668 1747752449 0.99
parquet_rs-zstd decompress time/CMSprovider 1919309584 1943632074 0.99
parquet_rs-zstd decompress time/Euro2016 384946329 390975089 0.98
parquet_rs-zstd decompress time/Food 221787219 219941971 1.01
parquet_rs-zstd decompress time/HashTags 630348334 646997093 0.97
parquet_rs-zstd decompress time/TPC-H l_comment canonical 559750720 572049276 0.98
parquet_rs-zstd decompress time/TPC-H l_comment chunked 558293448 566423943 0.99
parquet_rs-zstd decompress time/taxi 246824151 247414817 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2671438 2736414 0.98
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2701091 2685213 1.01
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 31485818 33064844 0.95
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 31612875 32773002 0.96
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 369611744 374044127 0.99
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 370807160 372144895 1.00
vortex-file-compressed size/Arade 150516940 145363828 1.04
vortex-file-compressed size/Bimbo 504880924 468763364 1.08
vortex-file-compressed size/CMSprovider 423737092 417907844 1.01
vortex-file-compressed size/Euro2016 163454156 163599188 1.00
vortex-file-compressed size/Food 43198680 41926968 1.03
vortex-file-compressed size/HashTags 205062708 195647860 1.05
vortex-file-compressed size/TPC-H l_comment canonical 181984528 179087392 1.02
vortex-file-compressed size/TPC-H l_comment chunked 181984528 179087392 1.02
vortex-file-compressed size/taxi 54941020 52363980 1.05
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930880 930880 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930880 930880 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293680 9293680 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293680 9293680 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957680 92957680 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957680 92957680 1.00
vortex:parquet-zstd ratio compress time/Arade 🚨 0 0 1.18
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.06
vortex:parquet-zstd ratio compress time/CMSprovider 🚨 0 0 1.16
vortex:parquet-zstd ratio compress time/Euro2016 🚨 0 0 1.11
vortex:parquet-zstd ratio compress time/Food 🚨 0 0 1.11
vortex:parquet-zstd ratio compress time/HashTags 🚨 0 0 1.35
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.09
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.09
vortex:parquet-zstd ratio compress time/taxi 🚨 0 0 1.46
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚨 2 1 1.10
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 2 1 1.07
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 🚨 1 1 1.12
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.05
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.03
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.04
vortex:parquet-zstd ratio decompress time/Arade 🚨 0 0 1.62
vortex:parquet-zstd ratio decompress time/Bimbo 🚨 0 0 3.06
vortex:parquet-zstd ratio decompress time/CMSprovider 🚨 0 0 1.58
vortex:parquet-zstd ratio decompress time/Euro2016 🚨 0 0 1.11
vortex:parquet-zstd ratio decompress time/Food 🚨 0 0 1.67
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.06
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 🚨 0 0 1.21
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 🚨 0 0 1.19
vortex:parquet-zstd ratio decompress time/taxi 🚨 0 0 1.64
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 1 1 0.96
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 1 1 0.94
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.06
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.02
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 0.97
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/Arade 0 0 1.04
vortex:parquet-zstd size/Bimbo 1 1 1.08
vortex:parquet-zstd size/CMSprovider 1 1 1.01
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.03
vortex:parquet-zstd size/HashTags 1 1 1.05
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.02
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.02
vortex:parquet-zstd size/taxi 0 0 1.05
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 15, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +28.7%
Vortex (geomean): 1.333x ❌
Parquet (geomean): 1.035x ➖
Shifts: Parquet (control) +3.5% · Median polish +23.0%

datafusion / vortex-file-compressed (1.247x ➖, 0↑ 10↓)
name PR 39d4ffa (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 710615863 701798578 1.01
tpch_q02/datafusion:vortex-file-compressed 787173475 748806559 1.05
tpch_q03/datafusion:vortex-file-compressed 989544832 762415772 1.30
tpch_q04/datafusion:vortex-file-compressed 🚨 904442362 639939029 1.41
tpch_q05/datafusion:vortex-file-compressed 1159899768 993106461 1.17
tpch_q06/datafusion:vortex-file-compressed 🚨 847380628 624834737 1.36
tpch_q07/datafusion:vortex-file-compressed 1163686552 1047379146 1.11
tpch_q08/datafusion:vortex-file-compressed 1219467565 1130750879 1.08
tpch_q09/datafusion:vortex-file-compressed 1473273870 1373265585 1.07
tpch_q10/datafusion:vortex-file-compressed 🚨 1308068728 987582540 1.32
tpch_q11/datafusion:vortex-file-compressed 🚨 714489156 494632578 1.44
tpch_q12/datafusion:vortex-file-compressed 🚨 1573449498 858929630 1.83
tpch_q13/datafusion:vortex-file-compressed 438413808 453536656 0.97
tpch_q14/datafusion:vortex-file-compressed 🚨 867988328 609785498 1.42
tpch_q15/datafusion:vortex-file-compressed 🚨 1531646868 1070394620 1.43
tpch_q16/datafusion:vortex-file-compressed 🚨 459965227 318963479 1.44
tpch_q17/datafusion:vortex-file-compressed 1287579252 1137481377 1.13
tpch_q18/datafusion:vortex-file-compressed 1358309947 1229250859 1.10
tpch_q19/datafusion:vortex-file-compressed 🚨 1070686086 715587071 1.50
tpch_q20/datafusion:vortex-file-compressed 🚨 1166686906 867645725 1.34
tpch_q21/datafusion:vortex-file-compressed 1834340342 1615730987 1.14
tpch_q22/datafusion:vortex-file-compressed 450066058 394666836 1.14
datafusion / vortex-compact (1.377x ❌, 0↑ 12↓)
name PR 39d4ffa (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 851563648 672455744 1.27
tpch_q02/datafusion:vortex-compact 🚨 877779044 567237125 1.55
tpch_q03/datafusion:vortex-compact 🚨 1241704724 661965319 1.88
tpch_q04/datafusion:vortex-compact 🚨 789919285 542365866 1.46
tpch_q05/datafusion:vortex-compact 1122161832 865620522 1.30
tpch_q06/datafusion:vortex-compact 🚨 828614397 559424253 1.48
tpch_q07/datafusion:vortex-compact 1258300738 1027294068 1.22
tpch_q08/datafusion:vortex-compact 🚨 2079990224 1038800854 2.00
tpch_q09/datafusion:vortex-compact 🚨 1877565148 1174773939 1.60
tpch_q10/datafusion:vortex-compact 🚨 1283390523 856671582 1.50
tpch_q11/datafusion:vortex-compact 🚨 647830882 383263746 1.69
tpch_q12/datafusion:vortex-compact 🚨 1658005403 790437038 2.10
tpch_q13/datafusion:vortex-compact 431755978 402681152 1.07
tpch_q14/datafusion:vortex-compact 🚨 845705764 606773392 1.39
tpch_q15/datafusion:vortex-compact 🚨 1549385466 1108158826 1.40
tpch_q16/datafusion:vortex-compact 427876388 377962645 1.13
tpch_q17/datafusion:vortex-compact 1282999728 1184716773 1.08
tpch_q18/datafusion:vortex-compact 1213049351 1065486723 1.14
tpch_q19/datafusion:vortex-compact 903164726 839169235 1.08
tpch_q20/datafusion:vortex-compact 1015541869 980054369 1.04
tpch_q21/datafusion:vortex-compact 1659773786 1817069951 0.91
tpch_q22/datafusion:vortex-compact 🚨 649160982 364533767 1.78
datafusion / parquet (0.983x ➖, 0↑ 0↓)
name PR 39d4ffa (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 808830083 848365607 0.95
tpch_q02/datafusion:parquet 783776615 863313769 0.91
tpch_q03/datafusion:parquet 914850130 999736413 0.92
tpch_q04/datafusion:parquet 458602912 504172756 0.91
tpch_q05/datafusion:parquet 1166202683 1138299307 1.02
tpch_q06/datafusion:parquet 545658953 516331801 1.06
tpch_q07/datafusion:parquet 1394510604 1321487696 1.06
tpch_q08/datafusion:parquet 1562357805 1775130211 0.88
tpch_q09/datafusion:parquet 1718171345 1801033312 0.95
tpch_q10/datafusion:parquet 2281615802 2106204144 1.08
tpch_q11/datafusion:parquet 549282415 734352441 0.75
tpch_q12/datafusion:parquet 701254638 668192286 1.05
tpch_q13/datafusion:parquet 693843305 674927200 1.03
tpch_q14/datafusion:parquet 747824653 791029105 0.95
tpch_q15/datafusion:parquet 1174975196 1144009265 1.03
tpch_q16/datafusion:parquet 389943801 342207227 1.14
tpch_q17/datafusion:parquet 1531071286 1331290230 1.15
tpch_q18/datafusion:parquet 1484539886 1464105067 1.01
tpch_q19/datafusion:parquet 990268653 992487136 1.00
tpch_q20/datafusion:parquet 1108697573 1225667493 0.90
tpch_q21/datafusion:parquet 1783320094 1854688041 0.96
tpch_q22/datafusion:parquet 793691664 784444311 1.01
duckdb / vortex-file-compressed (1.384x ❌, 0↑ 14↓)
name PR 39d4ffa (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 861478730 679396217 1.27
tpch_q02/duckdb:vortex-file-compressed 🚨 1658809135 1140938778 1.45
tpch_q03/duckdb:vortex-file-compressed 🚨 1403546570 938283224 1.50
tpch_q04/duckdb:vortex-file-compressed 🚨 907647426 627619186 1.45
tpch_q05/duckdb:vortex-file-compressed 🚨 1583467616 1087084115 1.46
tpch_q06/duckdb:vortex-file-compressed 🚨 1832573636 842850152 2.17
tpch_q07/duckdb:vortex-file-compressed 1393925292 1182255723 1.18
tpch_q08/duckdb:vortex-file-compressed 🚨 1974547127 1443286227 1.37
tpch_q09/duckdb:vortex-file-compressed 🚨 2022915317 1531864906 1.32
tpch_q10/duckdb:vortex-file-compressed 🚨 1821582684 1086567406 1.68
tpch_q11/duckdb:vortex-file-compressed 🚨 1122518157 678914388 1.65
tpch_q12/duckdb:vortex-file-compressed 🚨 1166018796 714836283 1.63
tpch_q13/duckdb:vortex-file-compressed 871053634 887539154 0.98
tpch_q14/duckdb:vortex-file-compressed 🚨 1449716071 869850701 1.67
tpch_q15/duckdb:vortex-file-compressed 616474725 551285767 1.12
tpch_q16/duckdb:vortex-file-compressed 590310402 465235883 1.27
tpch_q17/duckdb:vortex-file-compressed 1173742959 938871835 1.25
tpch_q18/duckdb:vortex-file-compressed 🚨 1223060845 913153978 1.34
tpch_q19/duckdb:vortex-file-compressed 958817879 792648963 1.21
tpch_q20/duckdb:vortex-file-compressed 🚨 1671111818 1196397957 1.40
tpch_q21/duckdb:vortex-file-compressed 🚨 2663068189 2025164599 1.31
tpch_q22/duckdb:vortex-file-compressed 712650619 583884063 1.22
duckdb / vortex-compact (1.327x ❌, 0↑ 10↓)
name PR 39d4ffa (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚨 848218942 586458754 1.45
tpch_q02/duckdb:vortex-compact 1342289234 1049596349 1.28
tpch_q03/duckdb:vortex-compact 🚨 1257862161 780715242 1.61
tpch_q04/duckdb:vortex-compact 🚨 742430758 530271107 1.40
tpch_q05/duckdb:vortex-compact 🚨 1342532678 1024535100 1.31
tpch_q06/duckdb:vortex-compact 🚨 1707210716 742644738 2.30
tpch_q07/duckdb:vortex-compact 1184861769 1041991962 1.14
tpch_q08/duckdb:vortex-compact 1553750690 1322198233 1.18
tpch_q09/duckdb:vortex-compact 1631681791 1276179383 1.28
tpch_q10/duckdb:vortex-compact 🚨 1832162654 1031253368 1.78
tpch_q11/duckdb:vortex-compact 🚨 855529996 652487663 1.31
tpch_q12/duckdb:vortex-compact 836289295 666139977 1.26
tpch_q13/duckdb:vortex-compact 791983130 883896753 0.90
tpch_q14/duckdb:vortex-compact 🚨 1403808116 899406799 1.56
tpch_q15/duckdb:vortex-compact 700391480 570459673 1.23
tpch_q16/duckdb:vortex-compact 485184241 465130302 1.04
tpch_q17/duckdb:vortex-compact 1063545863 882884825 1.20
tpch_q18/duckdb:vortex-compact 🚨 988520873 682366110 1.45
tpch_q19/duckdb:vortex-compact 852199632 717973185 1.19
tpch_q20/duckdb:vortex-compact 1403467538 1180326507 1.19
tpch_q21/duckdb:vortex-compact 🚨 2433015396 1731481877 1.41
tpch_q22/duckdb:vortex-compact 716550851 556828198 1.29
duckdb / parquet (1.091x ➖, 0↑ 0↓)
name PR 39d4ffa (ns) base 9406303 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 1044850602 916238221 1.14
tpch_q02/duckdb:parquet 1687826521 1595473929 1.06
tpch_q03/duckdb:parquet 1757659042 1563971157 1.12
tpch_q04/duckdb:parquet 1206333739 1184257890 1.02
tpch_q05/duckdb:parquet 2407991436 1998661898 1.20
tpch_q06/duckdb:parquet 878187789 861313468 1.02
tpch_q07/duckdb:parquet 1952806721 1652847548 1.18
tpch_q08/duckdb:parquet 2766379719 2330303650 1.19
tpch_q09/duckdb:parquet 2358407930 2302606641 1.02
tpch_q10/duckdb:parquet 3320611117 3464673612 0.96
tpch_q11/duckdb:parquet 973928943 926774894 1.05
tpch_q12/duckdb:parquet 1208764695 1076111181 1.12
tpch_q13/duckdb:parquet 1268316618 1225052627 1.04
tpch_q14/duckdb:parquet 1304395678 1231946722 1.06
tpch_q15/duckdb:parquet 932924586 882214702 1.06
tpch_q16/duckdb:parquet 874180854 847906762 1.03
tpch_q17/duckdb:parquet 1523645432 1233486891 1.24
tpch_q18/duckdb:parquet 1697641201 1364069290 1.24
tpch_q19/duckdb:parquet 1811703619 1540634432 1.18
tpch_q20/duckdb:parquet 1823972651 2014747838 0.91
tpch_q21/duckdb:parquet 2007861870 1865265975 1.08
tpch_q22/duckdb:parquet 1178427360 1012324715 1.16
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +26.6% +4.3% +21.4% +37.7% ➖ noise
1 datafusion:vortex-file-compressed +1.3% +4.3% -2.9% +49.2% ➖ noise
1 duckdb:vortex-compact +44.6% +4.3% +38.7% +39.0% ➖ noise
1 duckdb:vortex-file-compressed +26.8% +4.3% +21.6% +63.6% ➖ noise
2 datafusion:vortex-compact +54.7% -2.0% +57.9% +47.3% 🚨 regression
2 datafusion:vortex-file-compressed +5.1% -2.0% +7.3% +33.5% ➖ noise
2 duckdb:vortex-compact +27.9% -2.0% +30.5% +30.0% 🚨 regression
2 duckdb:vortex-file-compressed +45.4% -2.0% +48.4% +30.0% 🚨 regression
3 datafusion:vortex-compact +87.6% +1.4% +85.0% +43.9% 🚨 regression
3 datafusion:vortex-file-compressed +29.8% +1.4% +28.0% +50.8% ➖ noise
3 duckdb:vortex-compact +61.1% +1.4% +58.9% +39.1% 🚨 regression
3 duckdb:vortex-file-compressed +49.6% +1.4% +47.5% +46.1% 🚨 regression
4 datafusion:vortex-compact +45.6% -3.7% +51.3% +30.0% 🚨 regression
4 datafusion:vortex-file-compressed +41.3% -3.7% +46.8% +30.0% 🚨 regression
4 duckdb:vortex-compact +40.0% -3.7% +45.5% +30.0% 🚨 regression
4 duckdb:vortex-file-compressed +44.6% -3.7% +50.2% +30.0% 🚨 regression
5 datafusion:vortex-compact +29.6% +11.1% +16.7% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +16.8% +11.1% +5.1% +30.0% ➖ noise
5 duckdb:vortex-compact +31.0% +11.1% +17.9% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +45.7% +11.1% +31.1% +30.0% 🚨 regression
6 datafusion:vortex-compact +48.1% +3.8% +42.7% +30.0% 🚨 regression
6 datafusion:vortex-file-compressed +35.6% +3.8% +30.6% +30.0% 🚨 regression
6 duckdb:vortex-compact +129.9% +3.8% +121.5% +30.0% 🚨 regression
6 duckdb:vortex-file-compressed +117.4% +3.8% +109.5% +30.0% 🚨 regression
7 datafusion:vortex-compact +22.5% +11.7% +9.7% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +11.1% +11.7% -0.5% +30.0% ➖ noise
7 duckdb:vortex-compact +13.7% +11.7% +1.8% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +17.9% +11.7% +5.6% +30.0% ➖ noise
8 datafusion:vortex-compact +100.2% +2.2% +95.9% +30.0% 🚨 regression
8 datafusion:vortex-file-compressed +7.8% +2.2% +5.5% +30.0% ➖ noise
8 duckdb:vortex-compact +17.5% +2.2% +15.0% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +36.8% +2.2% +33.8% +30.0% 🚨 regression
9 datafusion:vortex-compact +59.8% -1.2% +61.7% +30.0% 🚨 regression
9 datafusion:vortex-file-compressed +7.3% -1.2% +8.5% +30.0% ➖ noise
9 duckdb:vortex-compact +27.9% -1.2% +29.3% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +32.1% -1.2% +33.6% +30.0% 🚨 regression
10 datafusion:vortex-compact +49.8% +1.9% +47.0% +81.3% ➖ noise
10 datafusion:vortex-file-compressed +32.5% +1.9% +30.0% +31.7% ➖ noise
10 duckdb:vortex-compact +77.7% +1.9% +74.4% +30.0% 🚨 regression
10 duckdb:vortex-file-compressed +67.6% +1.9% +64.5% +30.0% 🚨 regression
11 datafusion:vortex-compact +69.0% -11.3% +90.7% +30.0% 🚨 regression
11 datafusion:vortex-file-compressed +44.4% -11.3% +62.9% +30.0% 🚨 regression
11 duckdb:vortex-compact +31.1% -11.3% +47.9% +30.0% 🚨 regression
11 duckdb:vortex-file-compressed +65.3% -11.3% +86.5% +30.0% 🚨 regression
12 datafusion:vortex-compact +109.8% +8.6% +93.2% +30.0% 🚨 regression
12 datafusion:vortex-file-compressed +83.2% +8.6% +68.7% +30.0% 🚨 regression
12 duckdb:vortex-compact +25.5% +8.6% +15.6% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +63.1% +8.6% +50.2% +30.0% 🚨 regression
13 datafusion:vortex-compact +7.2% +3.2% +3.9% +30.0% ➖ noise
13 datafusion:vortex-file-compressed -3.3% +3.2% -6.3% +31.7% ➖ noise
13 duckdb:vortex-compact -10.4% +3.2% -13.1% +37.7% ➖ noise
13 duckdb:vortex-file-compressed -1.9% +3.2% -4.9% +45.7% ➖ noise
14 datafusion:vortex-compact +39.4% +0.0% +39.3% +30.0% 🚨 regression
14 datafusion:vortex-file-compressed +42.3% +0.0% +42.3% +31.8% 🚨 regression
14 duckdb:vortex-compact +56.1% +0.0% +56.0% +30.0% 🚨 regression
14 duckdb:vortex-file-compressed +66.7% +0.0% +66.6% +30.0% 🚨 regression
15 datafusion:vortex-compact +39.8% +4.2% +34.2% +30.0% 🚨 regression
15 datafusion:vortex-file-compressed +43.1% +4.2% +37.3% +30.0% 🚨 regression
15 duckdb:vortex-compact +22.8% +4.2% +17.8% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +11.8% +4.2% +7.3% +30.0% ➖ noise
16 datafusion:vortex-compact +13.2% +8.4% +4.4% +30.0% ➖ noise
16 datafusion:vortex-file-compressed +44.2% +8.4% +33.0% +30.0% 🚨 regression
16 duckdb:vortex-compact +4.3% +8.4% -3.8% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +26.9% +8.4% +17.1% +30.0% ➖ noise
17 datafusion:vortex-compact +8.3% +19.2% -9.1% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +13.2% +19.2% -5.0% +30.0% ➖ noise
17 duckdb:vortex-compact +20.5% +19.2% +1.1% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +25.0% +19.2% +4.9% +30.0% ➖ noise
18 datafusion:vortex-compact +13.8% +12.3% +1.3% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +10.5% +12.3% -1.6% +30.0% ➖ noise
18 duckdb:vortex-compact +44.9% +12.3% +29.0% +33.0% ➖ noise
18 duckdb:vortex-file-compressed +33.9% +12.3% +19.2% +30.0% ➖ noise
19 datafusion:vortex-compact +7.6% +8.3% -0.6% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +49.6% +8.3% +38.1% +30.0% 🚨 regression
19 duckdb:vortex-compact +18.7% +8.3% +9.6% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +21.0% +8.3% +11.7% +30.0% ➖ noise
20 datafusion:vortex-compact +3.6% -9.5% +14.5% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +34.5% -9.5% +48.6% +30.0% 🚨 regression
20 duckdb:vortex-compact +18.9% -9.5% +31.4% +30.0% 🚨 regression
20 duckdb:vortex-file-compressed +39.7% -9.5% +54.4% +30.0% 🚨 regression
21 datafusion:vortex-compact -8.7% +1.7% -10.2% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +13.5% +1.7% +11.6% +30.0% ➖ noise
21 duckdb:vortex-compact +40.5% +1.7% +38.1% +30.0% 🚨 regression
21 duckdb:vortex-file-compressed +31.5% +1.7% +29.3% +30.0% ➖ noise
22 datafusion:vortex-compact +78.1% +8.5% +64.1% +35.2% 🚨 regression
22 datafusion:vortex-file-compressed +14.0% +8.5% +5.1% +30.0% ➖ noise
22 duckdb:vortex-compact +28.7% +8.5% +18.6% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +22.1% +8.5% +12.5% +30.0% ➖ noise

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@gatesn gatesn Awaiting requested review from gatesn

At least 1 approving review is required to merge this pull request.

Assignees

@gatesn gatesn

@joseph-isaacs joseph-isaacs

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@mprammer @gatesn @joseph-isaacs